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ABSTRACT 

Several studies were conducted in 1987 by the 
Multilevel Evaluation Systems Project, which focrses on developing a 
model for a multi-purpose, multi-user evaluation system to facilitate 
educational decision making and evaluation. The project model 
emphasizes on-going integrated assessment of individuals, classes, 
and programs using a variety of indicators of educational quality and 
student outcomes. A prototype has been developed and refined through 
action research in collaboration with teachers, principals, and 
district decision makers in five school districts. In the process of 
developing a prototype microcomputer-based information system, the 
project studied issues related to the optimal content of information 
systems, the composition of quality indicators, useful reporting 
strategies for various levels, and the socio-organizational factors 
influencing the system's utility. During the first year of the 
project, through development and testing of the model, experience was 
gained in technical issues of implementation, including development 
of prototype computer software using the d-Base Ill-Plus package. 
Extensive documentation of prototype computer software for 
implementing the system is provided, and 11 figures are appended. 
(TJH) 
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INTRODUCTION 



This document presents the results o£ several sub- 
studies conducted during the last year by the Multilevel 
Evaluation Systems Project. The project has focused on the 
development o£ a model for a multipurpose, multi-user 
evaluation system designed to facilitate educational 
decisionmaking and to support school improvement and 
renewal • 

The project model emphasizes on-going integrated 
assessment of individuals, classes and programs using a 
variety of indicators of educational quality and student 
outccxnes. The model seeks to provide teachers and 
principals with useful information to analyze and improve 
the quality of their school and instructional programs while 
simultaneouly serving the accounteJ^ility and decisionmaking 
needs of district administrators. A prototype has been 
developed and refined through action research in 
collaboration with teachers, principals, and district 
decisionmakers from participating school districts. In the 
process of developing a prototype, microcomputer -based 
ir. formation system, the project has been investigating 
issues related to the optimal content of Information 
systems, the conposition of quality indicators, useful 
reporting strategies for various levels, and the socio- 
organizaticnal factors which influence the utility of the 
system. 

The first paper which follows, "Evaluation for school 
improvement: Try-out of a comprehensive school-based 
model*' , presents an overview of the model and the results of 
its implementation in five school districts. This paper 
summarizes our findings with regard to the types of 
information which need to be included in a useful 
information system, the types of reports in which teachers 
and administrators express interest, the socio- 
organizatlonal factors which affected implementation, and 
next steps for realizing a useful system. This paper has 
been submitted for journal review. 

The second paper, "Structuring, managment and analysis 
of multi-level evaluation system data", focuses on technical 
issues in implementing the laodel system, emphasizing in 
particular the problems of assuring data (quality and 
appropriate data use at the local level and their 
implication for future design. This paper was presented at 
the 1987 annual meeting of the American Educational Research 
Association, as part of a project organized symposium on the 
topic of improvement-oriented evaluation systems. 

The third section of this report presents doc\imentation 
of the current version of prototype software for 
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EVALUATION FOR SCHOOL IMPROVEMENT: 
TRY-OUT OF A COMPREHENSIVE SCHOOL-BASED MODEL 



Overview 

**Hov well are we doing?" "How can we make things 
better?" school boards, administrators and educators 
constantly ask such questions. They are, however, difficult 
to answer. While districts often collect a great deal of 
data as part of their routine evaluation activities, such 
data is often poorly suited to illuminate these basic 
issues. Collected in the names of sound management and 
rational decisionmaking, the data instead often sits unused 
on bookshelves, in thick computer printouts, and in 
inaccessible computer files, with little or no significant 
impact on the process of education in districts, schools, or 
classrooms . 

CRESST's Multilevel Evaluation Systems project seeks a 
more useful approach to evaluation by developing and 
implementing Baker's "top-down, bottom-up" evaluation model 
(Baker, 1983) . The model calls for context sensitive 
information for principals and teachers to help them improve 
their instructional programs and policy sensitive 
information for superintendents, board members, and other 
administrators to inform their program planning and 
evaluation. More specifically, the project has the 
following objectives: 

1. To develop and implement a model multipurpose 
evaluation system designed to facilitate educational 
decisionmaking and to support school improvement and 
renewal ; 

2. To develop and implement a core data base, drawing 
on a broad variety of quality indicators, that can 
serve the diverse decisionmaking needs of teachers, 
administrators and district policymakers; 

3. To develop and implement a data management system 
that will provide student level, class level, grade 
level, school district, and inter-district summaries 
across selected measures included in the data base; 

4. To extend our understanding of the production and 
use of information and its impact on educational 
innovation. 

The project model draws on accumulated knowledge about 
what makes school effective, about what makes evaluative 
information useful to teachers and administrators; about 
what makes an information system useful in organizations; 
and on the power of currently available, low cost 
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microcomputer technology. In the sections below, the 
rationale underlying the project model is summarized briefly 
followed by a description of its implementation in five 
school districts. We end by considering the implications of 
the pilot project for the future design of school-based 
information systems. 

Background 

The model is premised on the assumptions that 
evaluation can be a valuable tool for improving schools, and 
that the collection, analysis, and distribution of 
information can stimulate and inform action to upgrade the 
quality of education. It assumes that evaluation 
information can have such an affect by facilitating better 
educational decisionmaking, improved instructional planning 
and more effective school management at all levels of the 
educational hierarchy. District and school administrators, 
for example, can use valid information about student 
achievement, among other indicators, to make judgments about 
their schools' performance, to evaluate the effectiveness of 
particular programs, to establish grade, school, or district 
vide priorities, to allocate resources wisely, and to spot 
curricular or other problems needing correction. Using 
information about student test performance, attitudes, 
preferences, etc. in combination with their own perceptions, 
teachers might more easily and effectively accomplish 
critical tasks such as assigning students to groups, 
diagnosing individual learning problems, monitoring student 
progress, assessing subject matter mastery, identifying 
students who need remediation or enrichment activities. 
Teachers and the principal working together could use 
information about school context, instructional processes 
and outcomes to analyze local problems and improve the 
effectiveness of their school programs. School board 
members and district leaders could likewise use such 
information to get a comprehensive, accurate picture of the 
quality of their schools and to target their improvement 
efforts accordingly. 

But while evaluation information has this potential 
power, its impact has been quite modest (Alkin et al., 1979; 
Cohen & Caret, 1975; Patton, 1986). Why the discrepancy? 
The reasons appear to be many and varied. The source and 
nature of formal evaluation practice over the last two 
decades appears to be a major limiting factor. Much of this 
practive has led to the proliferation of standardized tests 
devoted to supplying the needs of legislators and 
administrators at the federal, state and local levels who 
wished to know how mandated programs were working and how 
schools were achieving. The people at the bottom — 
teachers and local administrators — have been seen as data 
providers rather than data users, as implementers of reform 
efforts rather that initiators of such efforts. 
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Teachers and local school administrators meanwhile have 
questioned the validity of these "top-down" evaluation 
efforts, arguing that required tests do not reflect what 
they are teaching and that some are inappropriate for 
particular groups of students (Herman & Dorr-Bremme, 1983). 
They claim further that the paperwork and bureaucratic 
burdens associated with mandated evaluation requirements 
intruded into, rather than supported, their own planning and 
improvement efforts. They have argued also that improvement 
of educational quality must be directed at local school 
sites where teachers and administrators directly interact 
with children. "Bottom-up" needs, in short, are not being 
well served by mandated evaluation and testing programs. 

Complementing these concerns were criticisms by some in 
the research community who also have questioned the value of 
standardized tests (Baker, 1983; Eisner, 1985; Sirotnik & 
Burstein, 1984). Criticized as providing a very limited 
view of educational quality, these tests, for the most part, 
examine student performance on only a narrow slice of the 
curriculum, emphasizing basic skills and giving little 
attention to learning in the content areas, higher-order 
reasoning skills, and the multiplicity of other academic, 
social, and vocational goals which schools are supposed to ^ 
address . 

Using "test scores only" to capture educational quality 
suffers from other validity problans as well. While the 
"How well are we doing" question provides impetus for much 
evaluation activity, answers framed solely in terms of test 
scores sometimes mask as much as they clarify. Contrary to 
what may be the belief of many policy makers, it is not 
possible to backward chain from a single test score to 
inferences about the overall quality of education in a state 
or district or at a particular school. Student test scores 
are the result of many factors, school quality among them. 
Cultural, social, economic, demographic and motivation 
factors also are clearly influential, but often ignored in 
giving districts or schools report cards. Inequities and 
invalidities result, crediting schools which serve 
advantaged populations and disadvantaging schools ser^/ing 
minority and poor students. 

But even if credible testing instruments were 
available, more broadly-based tests administered, and the 
results Integrated within a social/economic/ community 
context, a serious deficiency in many previous evaluation 
conceptualizations would remain. Evaluation in support of 
school Improvement at the local level should not be limited 
to the type of data typically collected: outcome data. 
Left undocumented by evaluations focusing only on outcomes 
are the processes and context features which create or 
contribute to those outcomes. Understanding these is 
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critical to directing an effective agenda for school 
improvement • Eisner speaks to this point: 

••If we want to understand why we get what we get from 
our schools we need to pay attention not simply to the 
scores, but to the ways in which the game is played." 

School context and process, thus, have not been used 
sufficiently as a source of explanatory hypotheses in 
routine evaluation practice (Sirotnik, 1984). They also 
have been neglected but as important intervening factors 
which influence how evaluation data themselves are 
interpreted and how they are used for school improvement and 
change (Sirotnik et al., 1985; Dorr-Bremme, 1984)- Having 
technically sound, comprehensive data available does not 
assure that anyone will look at them, analyze them, discuss 
them, or take action stimulated by them. A growing 
literature on factors which influence evaluation 
utilization (Alkin et al., 1979, 1985; Bank & Williams, 
1985), on factors which contribute to change and innovation 
in schools (Herman & McLaughlin, 1977; Sarason, 1982; 
Heckman et al., 1983) and on factors that affect the 
implementation of evaluation and information systems in 
fields outside of education (Lucas, 1975; Markus, 1981; 
Multinovich & Vlahovich, 1984) provides clues on knowledge 
utilization — factors such as leadership support, 
ownership, perceived relevance, fit with routine practice, 
incentives, etc. which can be expected to influence whether 
evaluation information is acted upon and used to alter 
existing practices. 

There are many reasons, in short, why evaluation has 
had only peripheral influence on teachers, principals and 
district personnel in their efforts to improve schools. To 
summarize: evaluation has been primarily linked with "top- 
down", ••highly centralized improvement approaches which have 
not been sensitive to ••bottom- up'^ needs; evaluation data 
has been based primarily on a narrow range of outcomes; 
evaluation often has ignored critical variables in the 
context and process of schooling; evaluations have not 
sufficiently considered the factors which would facilitate 
attention to findings and translation of findings into 
action. 

Recognizing these limitations, some school districts 
are currently developing innovative evaluation systems that 
serve multiple users and their diverse information needs 
(Bank & Williams, 1984, 1985; Idstein, 1985; Dussault, 
1985). Radical changes in evaluation methodology are 
emerging reflecting both the reality of our decentralized or 
••loosely coupled*^ educational system and the awesome power 
of computers. 
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Education comes down to what happens to students in 
classrooms and schools. Educational quality comes down to 
critical interactions between teachers and their students, 
behind the classroom door. Further, more so than in the 
past, schools and classrooms today encompass tremendous 
diversity in student population, in teacher skills^ in 
curricular goals, in teaching strategies. Because of this 
diversity and because of the locus of instructional control, 
the school building, rather than more remote and larger 
administrative units, is the appropriate unit for solving 
many educational problems (Goodlad, 1983; Baker, 1983). 
Consequently, school personnel are among the appropriate 
designers and beneficiaries of improvement-oriented 
evaluation systems. 

Individual schools however, often do not have 
sufficient resources, expertise, control, etc. to solve all 
their educational problems by themselves. Solutions 
frequently require initiative, direction, resources, and/ or 
actions at higher administrative levels, levels which have 
legal responsibilities for governance, personnel, resource 
allocation, and policy formation, among other things. These 
realities suggest the desirability of a system of evaluation 
which could provide local schools with a rich, locally 
sensitive information base to aid their problem-solving and 
which could also provide appropriate aggregate information 
for decisionmaking at higher levels of the system. One 
potentially promising approach is a distributed information 
system which gives actors at various levels immediate access 
to a shared core of data but enables them to supplement and 
analyze it in response to their specific decision needs. 
The relatively low cost availability of powerful 
microcomputer technology makes possible a number of 
intriguing options for local site processing, data 
networking and a variety of lateral and horizontal linkages. 



An Improved Model 

The limitations in current practice, the reality of the 
loosely coupled (Weick, 1978) educational system, and the 
availability of new technology all support the need for a 
new, top-down - bottom-up model of evaluation, one which 
provides quality data to aid the decisionmaking of 
policymakers and local school practitioners and one which 
provides a productive tool for improving the quality of 
schools. The background discussion and the problems it 
articulates foreshadow a number of features deemed critical 
for a such a valid and useful evaluation system: 

1. it makes relevant information easily available to 
teachers, school administrators, and district and state 
policymakers to aid their decisionmaking; 
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2. it includes information on a range of school 
outcomes ; 

3. it includes information on school context and 
student characteristics to contextualize outcome and 
effectiveness analyses; 

4. it includes information on school and instructional 
processes to elucidate and analyze local problems and 
accomplishment ; 

5. it links outcome information with instructional 
process and school context data to provide explanatory 
power for findings; 

£. it enables efficient sharing of information within 
and across levels of the educational hierarchy, 
minimizing redundant, overlapping testing and 
evaluation requirements; 

7. it includes externally fixed elements to assure 
sensiti/ity to information needs at the district and 
state levels and variable, locally selected elements 
and measures of interest to school professionals; 

8. it encourages data collection, analysis, and use 
over time; 

9. it builds on organizational and management 
strategies to facilitate system use including such 
things as: 

-locating responsibility for defining the system 
dually at the school and district levels 

-facilitating ownership and flexibility for local 
school uses 

-assuring leadership support at the district and 
school levels 

-attending to specific information and reporting 
needs to all groups 

-making the system user-friendly and easily 
accessible. 

Attending to these critical features, the project 
model utilizes a comprehensive information base about 
student characteristics, school context, school and 
instructional process and a range of outcomes that can be 
analyzed, arrayed, and appropriately reported at various 
levels to facilitate decisionmaking at the classroom, 
school, district, and perhaps state levels and to satisfy 
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The technical approach proceeded in four general steps : 



!• Deciding what needs the evaluation system should 
serve and the data that should be included within the 
core data base. 

2. Det^^nnining data collection procedures. 

3. Collection of data. 

4. Determining data analysis and reporting needs. 

Decisions in each of these areas were to guide the 
development and implementation of a user- friendly, 
microcomputer-based data management system to provide useful 
reports to teachers, principals, district administrators, 
superintendents and board members. (To enhance initial 
reporting flexibility and to avoid potentially costly 
reprogramming efforts, initial analysis were done on UCLA's 
mainframe computer.) 

Essentially parallel processes were used to accomplish 
each of the above steps. Working meetings including 
participants from all five districts were convened to 
consider each decision area, to determine common priorities 
from among a range of given options, and to review progress 
and proposed products. Follow-up meetings in each 
individual district were used to verify consensus, to 
identify unic[ue concerns and unique data requirements for 
each school/district, and to review instrumentation and 
reports. Data collection proceeded in two fourth grade and 
two fifth grade classrooms in each participating school; 
data collection included a combination of rostering archival 
data and administering specially developed student and 
teacher que^tioaairas. The results section below describes 
how the model was operationalized in the five districts, 
including the questions the information system was designed 
to elucidate, the types of indicators considered relevant, 
and the types of analyses and reports deemed useful. 

Results 

What needs and concerns should the evaluation system 
meet? Whil« there was considerable diversity in the types of 
concern^ expressed, several common questions emerged across 
the working groups. Their questions concerned the outcomes 
of schooling for students, the nature and effectiveness of 
the educational process, and the influence of the context in 
which instruction occurs. More specifically, their 
questions included: 
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StUQ:>nt Outcomes 

o How much growth do students show over time? 

o How does student performance compare to that of 
similar students in other districts? 

Process 

o Are resources effectively allocated and used? 

o What instructional practices contribute to quality 
education? 

o Are educational programs challenging and appropriate 
in their levels of expectation for students? 

Context 

o Can school climate contribute to quality student 
performance? 

o What's the role of student background in their 
performance? 



Concerns unique to each district focused on academic 
performance in specific subject matter areas, the 
effectiveness of particular instructional practices, the 
special needs of students from particular backgrounds, and 
the influence of contextual features specific to the 
district. 

What Indicators might help illuminate these questions ? 
Starting with an initial pool of potential indicators 
identified on the basis of the literature, a core list of 
priorities was identified for student outcomes, 
T«^truc**ional process, school context, and student 
aemooraphic characteristics. Highly ranked elements across 
all five districts were student outcomes as indicated by 
standardized achievement test scores (reading, math, 
language) as well as affective outcomes such as attitudes 
toward school and academic self -concept. A broad range of 
student characteristics were viewed as important, including 
identification information such as sex, ethnic background, 
years at current school, and program designation (e.g.. 
Chapter I, Special Education, Gifted). Highly ranked 
instructional practices included primary learning goals and 
objectives, instructional time, and expectations for 
achievement and class conduct. Important contextual 
features included quality of worklife (for teachers, school 
staff, and administrators), school climate, and parent 
involvement. In addition, each district designated specific 
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elements witnin each category as important based on their 
i^nique situation, improvement priorities, and concerns. 

Following screening for measurement feasibility and 
political consequences, consensus was reached that the 
following data elements would comprise the core database 
system: 



Backround Information About Students 
Age 

Grade level 
Sex 

Ethnic backround 

Time at current school 

Time in district 

Attendance/absence rate 

Socio-economic status 

Language status 

Special program participation 

Information on Student Outcomes 
Reading achievement 
Math achievenent 

Attitude toward reading, including liking, perceived 
importance, self-confidence 

Attitude toward Math, including liking, perceived 
importance, self-confidence 

Attitude toward school, including motivation, academic 
self concept, sense of control, instructional mastery 



Classroom Processes 

Use of instructional time 

Expectations of achievement 

Amount of homework 

Use of individualized instruction 

Use of instructional resources and materials 

Student instructional preferences (materials ari 

activities) 

School Content 

School climate: Perceptions of physical plant 

Perceptions of principal 
Perceptions of teachers 
Perceptions of other students 

Parent participation 
Frequency of parent help 
Parent support for school 
Parent knowledge j^>>out school 

What kinds of analysis and reports are desired? 
Presented with a variety of options, users appeared torn 
between simple visual displays which graphically highlighted 
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trends or group patterns on one or a few variables and their 
desire to see "everything at once" on a single page or on a 
single screen. Thus, although almost everyone in the group 
fo^ind graphics more appealing than numbers, they also wanted 
rosters that would enable them to see all scores at once. 
In general, as one might expect, district superintendents 
were more interested than teachers in looking at trends over 
time and were more sophisticated in their ability to analyze 
the data in depth and in their ability to understand more 
complex displays (e.g., analyses of score distributions over 
time). Teachers, in keeping with their responsibilities, 
were more satisfied with simple bar charts which enabled 
them to analyze their classes at single point in time. Both 
reporting formats and preferred types of analyses, in other 
words, differed for the various user groups. Based on 
initial preferences, the following reports by user group 
appeared to be desireable: 

Distrxct superintendents 

Student achievement in reading and mathematics and 
their attitudes for the district as a whole and 
for each school, including longitudinal tracking 
of the same cohort over several years; and cross- 
sectional analysis of the same grade levels over 
time. They were interested in displays which 
would give them a sense of the mean as well as the 
score distribution, (e.g., box plots) and wanted 
to be able to examine the performance oi: all 
schools within their district on a single ^jraph. 
They also wanted to be able to see and track over 
time the proportion of students in theii district 
scoring in each national quartile; 

Group comparisons (by grade) of student 
achievement in reading and mathematics by SES 
(high, medium, low) , by sex, by ethnicity, by 
special program, by regularity of school 
attendance (absent less than 10 days, between 10 
and 20 days, 20 or more days annually), and by 
years in current school (new vs. longer term 
resident students) ; 

Overall school climate by school; 

Scattergrams for any significant relationships 
found between any of the instructional or school 
context variables and student achievement and 
attitudes ; 

District profile and school profiles rostering all 
outcomes, school climate, and demographic 
variables . 
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School P rincipals 



Student achievement in reading and in math over 
time by student; by class; by grade for their 
school; by special program participation for their 
school; and by student demographic 
characteristics ; 

Student attitudes by grade; 

Selected instructional process and school context 
variables, including expectations for achievement, 
amount of parent support and amount of homework by 
student; by class, and by grade; 

Relationships, if any, between time and 
achievement, parent participation and achievement, 
expectations and achievement and between attitudes 
and achievement. 

Teachers 

Roster of individual students to include all 
student background characteristics except SES; all 
outcomes; parent support/help with schoolvork; 
instructional preferences, and perceptions of the 
school climate; 

Breakdowns of their class by grade level; 
ethnicity; attendance rates; special program 
status; each outcome; each instructional process 
and school context variable; 

School by grade level breakdowns by ethnicity; 
absence rates; language status; special program 
participation ; sex • 

Design Consideration 

The above preferences provide a blueprint for analysis, 
without regard to the appropriateness, technical quality, or 
confidentiality of particular data sources. For example, 
teachers wanted individual responses about students' 
attitudes and school climate (including perceptions of the 
teacher) • Yet it is questionable whether student attitude 
measures are sufficiently reliable at tl'^, individual level 
to warrant that level of diagnosis and attention; it is 
likewise voot whether students will answer honestly about 
their perceptions of the teacher if they know that their 
teacher will have direct and easy access to their responses. 
Similar questions arise with regard to teachers' or 
principals' responses to sensitive school issues. (This, in 
fact, was the reason why "quality of work life" was deleted 
from the original set of system elements.) 
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The reporting priorities articulated above also are 
generally mute about what constitutes appropriate and 
meaningful summary statistics for reporting various process 
and outcome indicators. These are partially technical 
decisions based on the nature of the assessment devices 
employed but user preferences are equally important if 
utility is to maximized — i.e., what kinds of summaries are 
perceived as most familiar, easily understandable and/or 
meaningful? With norm- referenced assessments, for instance, 
a wide variety of derived scores are possible, e.g., 
percentile scores, NCE's Grade equivalents, stanines, 
quartiles; and each type of score can be characterized in a 
variety of ways: mean, median, percentage of students 
scoring above, below, and/or within a particular score 
range, e.g., mean percentile scores, percentage of students 
scoring above grade level, percentage of students scoring in 
the highest quartile compared to the national norm group. 
Further, what constitutes meaningful cut-off point for 
reporting score distributions will vary depending on the 
local context and priorities. For example, an inner city 
school might want to examine the percentage of students 
scoring at or above the national average as an indicator of 
effectiveness, while the cut-off point for a more advantaged 
suburban environment might be quite different. 

The choice of meaningful cut-off scores, in other 
words, is an interpretation issue that needs to be resolved 
during analysis. Regardless of whether the measures are 
more criterion-referenced or nationally normed, the nature 
of the local distribution and human judgment will need to be 
taken into account. In our study, many of the student 
questionnaire items, including the attitudes toward reading 
and mathematics scales, used Likert type scales that 
generally represents the range from very negative to very 
positive. How should mean scores from such measures be 
interpreted? What represents a positive response, a 
negative response, a neutral response, particularly given 
the nature of self-report measures? Is there a cut-off 
point above which or below which scores deserve special 
scrutiny? Similarly with the interpretation of attendance 
data. What is satisfactory attendance? what level 
indicates a potentially significant problem? 

The interest across all groups in an "everything at 
once on a single page" roster that might provide an overall 
picture of quality and performance and at the same time 
enable users to detect potential trouble spots gives rise to 
additional scaling and interpretation concerns. How do 
users compare performance across various indicators, 
particularly when some are norm-referenced, some are 
criterion-referenced, and others reflect different scales? 
An intuitive solution was used to solve the problem. To 
counteract evaluation's negative image, the reports were 
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designed to emphasize the positive; we chose group summary 
indicators that would be constituted as "percent responding 
positively.*^ What counted as "responding positively" was 
defined by the measure as interpreted by local users: for 
nona-referenced achievement measures, it meant scoring at 
least one-half year above grade level; for the norm- 
referenced attitude measure, it meant scoring at or above 
the 70 percentile; for point scale. Additional work needs 
to be conducted to arrive at more elegant, technically 
grounded solutions, but the point to emphasize is that users 
wanted and needed some kind of common scale against which 
they could intarpret all the data. 

Jsaae considr.rations. As users examined the reports, a 
number of observations were apparent. (Figures 2-11 in the 
appendix display some sample reports.) First and foremost, 
teachers and principals generally were uncomfortable in 
dealing with numbers and needed considerable support in 
understanding them. This was not necessarily a problem with 
the reports theiaselves but rather speaks to the extensive 
orientation/training that educators may need prior 
to or accompanyin.7 system use. What do the different scores 
and statistics mean? How should they be interpreted? 
What's a productive strategy for delving into the data? 
Further, this apparent anxiety about numbers and dealing 
with data meant that displays need to be labelled as clearly 
and as completely as possible and short-hand titles or 
abbreviations avoided. To help guide naive users' 
inquiries, it may also be helpful to frame displays in terms 
of the cpiestion(s) that the data can help answer. 

The technical naivete of the potential users brings 
with it also the problem of guarding against the 
misuse/misinterpretation of the data. For example, in one 
district report, students' test score performance was 
compared by ethnic group. In several c^^es, there was only 
a couple of students representing a particular group and any 
conclusions would be unfounded and erroneous. Rather than 
assuming that users will know when particular analyses are 
inappropriate, it may be better to program the system to 
suppress analyses under given conditions. This parallels 
the suggestion made earlier regarding suppressing access to 
data that may violate privacy or standards of technical 
quality for particular levels of use. A similar issue 
relates to data access. Who shall have access to what data? 
Are there political or other reasons to restrict access to 
particular data elements or particular levels of analysis? 
What safeguards need to be provided and how? 

Another observation relates to the continuing tension 
between individualized reporting options and ease of report 
access. It was clear with the ^at a glance" rosters, for 
example, that different users representing the same role 
group wanted different data elements included on the form 
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(it is not possible to Include everything on a single page 
or screen) ; as another example, there were many Individual 
differences in preferred graphic displays and tolerance for 
niunbers of elements displayed. A reasonable compromise may 
be to provide standard reporting options for easy access, 
but enable more dedicated or more computer-comfortable users 
an option to design their own analysis forms. 

Finally, it appears that the types of reports desired 
by the different levels of users may need to vary not only 
in the level of analysis but in the sophistication of the 
display. Superintendents continued to be interested in stem 
and leaf plots and other displays which gave them a sense of 
the score distributions while teachers were desirous of more 
simplified pictures. To avoid endless arrays of menu 
selections, it may be more effective to branch the program 
by user group and customize the reports to each groups' 
needs; reports may also need to be customi?;8d for each 
individual district. In any event, additional interactive 
work is n«»eded with each user group to be more sensitive to 
their preferences, interests and concerns. 

Summary and Conclusions 

The field test of a prototype multilevel evaluation 
model in five school districts produced a niunber of 
important lessons for future project design. First and 
foremost, teachers, principals, district administrators, and 
school board members were interested in getting better 
information about the quality of their schools and 
interested in a broad array of information to aid their 
decisionmaking. They were enthusiastic about both 
broadening available data beyond standardized tests and 
being involved in the decision process. There also was 
substantial agreement across the various groups on the types 
of Indicators and data that would be most beneficial. 

However, data-based decision making is a new concept 
for most teachers and principals, and although familiar to 
district administrators and policymakers, they have little 
experience with its many possible iterations. The amount of 
support intended users need in envisioning a comprehensive 
system and how its data might be used to help them to 
accomplish their responsibilities should not be 
underestimated. For example, users needed far more 
orientation to the model concept, to the potential role of 
data in teaching, school and district decisionmaking and 
policy needed, and to specific, concrete examples of use 
prior to trying to articulate their own information needs or 
subsequent analysis and reporting needs. 

Further, and related to the first point, because a 
data-based information system represented a new idea and an 
innovation in the ways school? and the personnel within them 



typically operate, its implementation required sustained 
attention to the organizational and socio-*^olitical factors 
which facilitate change. The process of implementation was 
designed to promote user ownership in the system by trying 
to build the system around user needs and getting their 
input and reactions at each step; further we tried to foster 
district ownership and responsibility for the project by 
establishing steering committees within each district and ^ 
requesting that one person be designated as coordinator for 
wi thin-district operations. In addition, because the 
superintendents were enthusiastic about the project and 
their districts' participation in it, and because principals 
volunteered their schools for the project, we assumed that 
critical leadership support would be forthcoming as would 
sustained interest and attention to the project. We assumed 
that each district could be relatively self-sustaining and 
manage its own process without extensive intervention or 
support from the project coordinator. These assumptions, 
unfortunately, turned out to be partially erroneous. 
Bringing teachers, principals and other administrators in 
for several central planning meetings was not sufficient to 
build their ownership; considerably more interaction was 
required^ Although steering committees were implemented and 
responsibilities assigned, the locus of the project 
apparently was perceived by some districts as outside their 
district — potentially a function of the fact that 
participants had difficulty envisioning exactly what the 
final product was going to look like or what it was going to 
do for them, or how it fit within their work routines. In 
addition, crises emerged in some districts which eclipsed 
the salience and importance of the project and the attention 
it was accorded by school leadership. Time delays in the 
project further eroded support. The bottom line was that 
project activities were perhaps viewed as more peripheral 
than central to participants, and their project commitment 
and memory needed further bolstering. Future implementation 
will need to pay greater attention to the organizational 
structures and incentives supporting the project and to 
facilitating group process both within and across projects. 

Quality control also emerged as an important problem 
area. Project participants in the main arc unschooled in 
the technical requirements for rigorous data collection and 
coding; as a result, things which we as researchers take ac 
self-evident (and provided directions for), e.g., the need 
to carefully designate student ID numbers and/or teacher ID 
niunbers and/or school ID numbers on all completed 
instniments, did not receive the care we had naively 
anticipated. Early and repeated checks for data quality, m 
short, need to be built into the system. At a minimum, 
districts needed more precise and prescriptive directions 
for handling data and assignment of ID numbers; in our 
directions, we tried to be responsive to individual 
differences in district practices by providing flexible 
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guidelines. Our good intentions, however, ended up doing 
the districts a disservice; more prescriptive rules would 
have been easier to follow. In addition, any data entry 
process should routinely check for out of range values and 
for consistency and accuracy of ID numbers. 

Fourth f while data about school and instructional 
process are critical in a sound evaluation system, the 
feasibility of collecting data that is sensitive to intended 
uses bears further scrutiny. It is moot whether easily 
collected self-report data are sufficiently precise to 
support school and clai>s level planning or process-outcome 
analyses. However, while more indepth observational 
approaches are possible, their time, resource and commitment 
requirements raise difficult cost-benefit questions. 

Finally, we are left with an overall strategy cjuestion 
about the optimal approach to system development and 
implementation. The project reported here attempted a "top- 
down, bottom-up" approach to the development process, 
merging our own top-down vision of what the project might 
look like and accomplish with the bottom-up needs of the 
various users groups. Neither set of requirements were 
initially fully specified and this caused tensions and 
impediments throughout the development process. Rather than 
combining the two approaches, it perhaps would have been 
better to begin with one or the other: e.g., start with a 
fully flushed out version of an information system and the 
sets of questions and problems it could address, and then 
modify/adjust the system to accommodate bottom-up needs; 
that is, start top-down with an imposed order, but then let 
local users adapt to their context. Another approach would 
be to start bottom-up with explorations of the problems and 
decisions that particular user groups are faced with and 
work interactively with them to discover the ways in which 
data can help them and the reports and displays that are of 
greatest use. Which of these is the more effective approach 
is an empirical question worthy of future study. 
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Structuring, Management and Analysis of 
Multi-Level Evaluation System Data 

IntroduGtion 

The Multi-Level Evaluation System project has provided an 
excellent opportunity to explore many of the complexities of the 
management and analysis of data arising from diverse sources for 
a school-based system intended for multiple level uses. The 
overall goal of the project was the development and 
implementation of a top-down, bottom-up evaluation model which 
would provide both context sensitive and more general level 
information for use by teachers, administrators, and district 
policymakers. Specific project objectives were as follows: 

1. To develop and implement a school-based multipurpose 
evaluation system designed to facilitate educational 
decisionmaking and support school improvement and renewal; 

2. To develop and implement a core data base that can serve the 
diverse decisionmaking needs of teachers, administrators and 
local policymakers, drawing upon a variety of quality indicators 
and sources of information to support the school improvement 
process; 

3. To develop and implement a micro-computer-based data 
management system that will provide student level, class level, 
grade level, school district, and inter-distric^ summaries across 
selected measures in the data base; 

4. To extend our understanding of the production and use of this 
knowledge and its impact on educational innovation. 

A prototype development project was conducted in 

collaboration with five school districts. The districts agreed 

upon and collected a common core of data for their systems. The 

resulting project data base contained a variety of demographic, 

achievement, perception and attitudinal information on 892 

students representing two grade levels (4th and 5th) at eight 
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schools. 

This paper focuses on the issues and implications emerging 
from the pilot related to data collectionr management and 
analysis of am icro-coraputer -based multi -level evaluation 
systems* Specific topics discussed include: (1) computer system 
considerations; (2) requirements for data collection, structuring 
and management; (3) implications for data analysis; and (4) 
specific recommendations for the implementation of similar 
projects . 

Computer System Considerations 

While a school -based micro-computer driven system was 
envisioned as a final product, UCLA's mainframe computer was used 
for the prototype. The rationale behind this choice was 
threefold: (1) to increase the flexibilty and speed with which 
data could be cleaned and structured into a complex data base; 
(2) to minimize initial programming efforts by taking advantage 
of readily available canned data management, statistical analysis 
and reporting programs; (3) to maintain flexibility in report 
production procedures prior to tinalizing the format of desired 
district, school, and classroom reports. 

In addition, cent alizing our data base development efforts 
by compiling one huge data s ^ containing information from all 
five school districts was intended to result in significant 
efficiencies. Ideally, each district would provide the 
information in exactly the same manner and the resulting data 
base would be consistent across districts. Consequently we 
anticipated that data cleaning, management and analysis could 
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proceed for all districts simultaneously. 

All data management and analysis for this stage of the 
project was carried out at the UCLA Office of Academic Computing 
(OAC) facility. The OAC maintains an IBM 3090-200 mainframe 
computer and c* variety of peripheral hardware (tape drives, 
exstensive direct link terminals, disk packs and printers). The 
OAC system had several tape drives and the necessary software 
which was capable of reading and writing numerous combinations of 
tape specifications. Complete with a real memonry capacity of 
128 megabytes (compared to the standard 640 kilobytes of the 
standard AT type micro-computer), the mainframe was capable of 
analysing huge data sets with speed and efficiency. In addition, 
it was possible to download data created on the mainframe to 
forms acceptable for micro-computers. In general, the mainframe 
offered the needed flexibility the project required and allowed 
for the production of a data base which woulc: serve as a 
reasonable prototype for future work in the micro-computer multi- 
level evaluation system. 

fiAta gQllegj^inn, StruGhnrlng Management 

A major project task involved the identification of the 
types of information to be collected for inclusion in the data 
base. Planning meetings were held with representatives from each 
end-user level group (district superintendents, school principals 
and classroom teachers) to identify the specific data to be 
collected. The desired information inclL^.ed data regarding 
fjtudent background and achievement outcomes, information on 
classroom process and school context (assessed at both the 
student and teacher levels) and specific student perceptions and 
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attltudlnal data. Once the informational needs of these users 
had been identified, specific data collection activities 
commenced. A complete list of variable content is given in Table 
one. 

One of the first challenges in the data management/ analysis 
phase of the project involved the compilation of raw data from 
several different sources. First, archival standardized 
achievement test data were obtained by each district and sent on 
to UCLA Data for inclusion in the data base came in two forms, 
as either test publishing company tapes or hard copy data from 
school reports. 

Second, students participating in the project were surveyed 
at their respective schools to obtain data on their perceptions 
and attitudes re«^ardlng classroom process, school climate and 
school related attitudes, perceptions and preferences. 
Participating classroom teachers also received questionnaires to 
obtain their perceptions of classroom process and school content. 
Student demographic data were obtained from district or school 
records. 

To facilitate the process of data collection and processing, 
participating districts were provided with directions for 
rosterlng, coding and subsequent keypunching of demographic data. 
Specifications were also provided for the preparation of 
achievement test tapes. Student background data included age, 
sex, ethnicity, special federal and local program participation, 
school attendance and in many cases socio-economic data based on 
parents* occupation. Unfortunately these data elements tended to 
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Table One. Variable Content of Data Base 
student Demographiff ^jxd Bacicg round Data 

Age 

Grade 

Sex 

Ethnic background 

Time at current school 

Time in current school district 

Attendance/absence rate 

Socio-economic status 

Language status 

Special program participation (federal and local programs) 
Student Qutgomeg 

Math achievement - includes conceptual, computational subscales 

to total scores 
Reading achievement- inoludes2to 3reading subscales 

(dapending on the test used) and total 
reading scores 

Attitude toward reading - includes liking, perceived importance, 

and reading self-confidence 
Attitude toward math - includes liking, perceived importance, and 

math self-confidence 
Student Attitude Measure - includes the following subscales: 

Motivation for schooling 
Academic Self-Concept (performance based) 
Academic Self -Concept (reference based) 
Student's se ^e of control over performance 
Student's inbtructional Mastery 

ClaggrQQm ProG^gfleg 

Use of xnstructional time 

Student expectations of achievement 

Amount of homework 

Preferences for use of individualized instruction 
Preference for use of instructional resources and materials 



School Conteitt 

School climate: perceptions of physical setting 

perceptions of principal 
perceptions of teachers 
perceptions of student 

Parent participation: frequency of parental assistance 

parental support for school 
parental knowledge concerning school 



ERLC 



III - 5 

32 



Multi*Level Evaluation Data 



Long 



vary widely across the participating districts. For example, 
while one district maintained attendance data as a percent o£ 
days absent over total days in the school year, another district 
provided attendance data as the total number o£ days each student 
attended. Ethnicity was also specified differently by the 
various districts. Some districts maintained records with three 
or four categories (White, Black, Hispanic and Other) while 
other districts used a six category coding schema (White, Black, 
Hispanic, Asian, Native American and Other). Such differences 
seriously impeded planned efficiencies of scale in data 
processing: analysis of each district had to be performed 
Individually. 

Standardized achievement test data similarly hampered 
attempts at uniform processing. While standardized tests in 
reading and math were routinely administed in each district, the 
specific tests differed (the ITES/Hulti-level, ITBS/CogAv. and the 
ITBS/PB achievement tests were nsed by one or more districts), 
and even within a single district, different ^ubscales were 
administered at different grade levels, further complicating the 
comparisons necessary for data analysis. 

Another difficulty in incorporating achievement test 
information involved the manner in which students had been 
identified for testing purposes. Identifying project students 
emerged as a real difficulty. Often tapes were sent directly 
from the testing services and typically contained data from all 
students in a particular grade, at either the school or district 
level, rather than only those classrooms participating in the 
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project* Isolating the data for the project was further 
complicated by differences in identification code specifications 
between the pubJishers* tapes and the project* For examplef in 
one district achievement test tapes identified students by the 
first eight letters of their last name and the first six letters 
of their first name; project identification code numbers were 
absent* In another case, the identification code incliaded on the 
test tape did not match those used in the district demographic 
data sets* Consequently, it was necessary to re-create the 
achievement test id's by altering the input statements on data 
sets that contained students full name and district 
identification codes* Using these re-created ID*s, it was 
possible to link student's achievement data with other 
information currently in the project data base* 

Student perception and attitude data were collected at the 
school level and questionnaires were keypunched according to 
prior specifications* While the resulting data sets were 
consistent across all students regardless of the district and 
grade level, several student identification inconsistencies 
became apparent during the data cleaning process* The original 
ID configuration was to contain district, school, teacher and 
individual student identifiers* However, district achievement 
and student background data often identified individual schools 
by code numbers different from those assigned for the purpose of 
the project* Teacher identification numbers were often assigned 
at the school level rather than at the district level* 
Therefore, despite prior instructions to the contrary, it was not 
uncommon to have the same ID code assigned to more than one 
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teacher within a district* Further, some students had not placed 
their assigned ID number on their questionnaires* In these 
cases, it was necessary to return to the original questionnaires 
to locate student's name and match their responses to the data* 

Most o£ these problems were eventually resolved by the 
care£ul construction o£ a master ID data set containing all the 
different identification codes from different data sources 
(demographic, achievement and questionnaire data), along with 
students* full names, teacher, ^^rade, school and district. Using 
this master data set, it was possible to merge all the data into 
the final data base* 

The resulting data base contained 892 students and 426 
variables* This data base was limited by missing data elements 
at each level of data* For example, socio-economic information 
was not available for some students, and other students were 
absent during the adminstration of standardized achievement 
tests* However, despite missing information, the basic data base 
contained well coordinated, comprehensive data which would 
present several challenges for analysis* 
Data Analysis 

The results of planning meetings, as expected, indicated 
that district superintendents, board irembers, principals and 
teachers desired different levels of analysis and reports; all, 
however, were interested in summary tables which would enable 
them to see everything at a glance, and in graphical displays* 

SAS (Statistical Analysis System) was used for all data 
management and analysis procedures* Becauses SAS graphics 
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options were more limited than we had originally anticipated^ 
vertical percentage and horizontal mean bar graphs were selected 
for presentation of descriptive data. Further, the SAS CHART 
procedure was used to compare performance of different groups 
(grades, sex, etc.) on the same graph based on pre-specif ied 
grouping variables. We experimented with pie charts, box graphs 
and other forms of graphical presentation, but the multiple 
groups bar graphs proved the least confusing of all our options. 

The SAS CHART procedure produced graphs which allowed for 
the inclusion of a variable name (8 characters) and a descriptive 
label (40 characters) on each graph. Levels of any grouping 
variable used in the graph could only be represented by an eight 
character label (e.g., "male", ^female", etc.) and were presented 
on the resulting graph in alphabetical order. Even following 
careful creation of group labels, variable names and descriptive 
labels, several of the graphs produced by SAS still required 
additional labelling. 

Summary tables containing means for continuous subscales 
(school climate, achievement outcomes) and percentage breakdowns 
for categorical data were constructed for more detailed 
descriptive data. One problem commonly incurred in analysis 
Involved missing data elements. Demographic data often proved 
the least attainable, and groupings based on this Information 
often contained only a few students and did not accurately 
represent the total data for a given classroom. 

Relational analyses were limited to correlations. 
Correlations were performed on student outcome and classroom 
process and school context and the results were presented in 
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simple matrices^ The final reports included demographic, student 
perception, attitude and outcome profiles. In addition, teachers 
wanted classroom posters which would display outcome and attitude 
data on one page. 

A serious implication of the reporting phase involved the 
potential misuse of information based on extremely small numbers 
of students (e.g. graphs illustrating the performance of groups 
stratified on demographic variables). In many cases, missing 
data resulted in only one or two students representing a given 
demographic group (ethnicity or SES). Conclusions based on 
apparent differences between groups containing small numbers of 
students would be erroneous since there is no way to determine 
the representiveness of these students. 
QatA Transfer 

The final task following analysis and report produ'^tion was 
the preparation of data for future use in a micro-ccmputer 
environment. Several considerations were necessary prior to this 
transformation. First it was necessary to determine what system 
would be used for future work with the data base. One of the 
goals of the project was to compile a prototypical data base for 
use on an micro-computer based evaluation system. Consequently, 
the data would need to be transferred to a media ultimately 
compatible with micro systems. Since ioost micro-computers are 
not equipped to handle tapes, it was obvious that data would 
eventually need to be downloaded to floppy diskettes. 

It is not uncommon to copy a mainframe SAS data set to tape 
for backup purposes; however, the transfer of these tapes between 
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mainframe facilities is generally not recommended due to problems 
with system incompatibility* Consequently^ it would be necessary 
to download the data to a micro-computer system at UCLA and then 
send the diskettes to Pennsylvania* While the downloading of 
ASCII format data or text from mainframe to floppy diskettes is a 
relatively simple procedure, downloading SAS data sets was a new 
challenge* UCLA had recently installed the SAS R-LINK procedure 
which would transfer SAS data sets on the IBM mainframe down to 
SAS sets on a micro-computer* 

The transfer process was a complex one requiring 
communications to be set up between the SAS programs on the micro 
and mainframe computers simultaneously* Usiug a modem to 
establish the communication link between the mainframe and the 
micro-computers, it was necessary to access the mainframe data 
set through an interactive support facility and then transfer the 
data directly to the micro-computer SAS program (SAS-PC) to 
floppy di9!;ettes* 

Because of the size of the data base, it was necessary to 
create smaller data sets containing all the information from one 
district* Only one of these district data sets was small enough 
to be contained on a single diskette* The remaining four 
district data sets required further partitioning* Three of the 
four remaining district data sets were partitioned by student 
into smaller sets* Each of these three district data sets was 
split into two smaller data sets containing all the variables, 
with 100 students in the first set and the remaining students in 
the second data set. The resulting two smaller data sets would 
only require appending (the adding of one set to another) to 
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reconstruct the original district data set« 

The fifth district data set was so large that it had to be 
partitioned several times resulting in a total of ten separate 
data sets* Because of the large number of variables for this 
data set (complete demographic data; several achievement test 
item scores, subscale scores and total scores and other test 
equivalents; and all questionniare data) and the large number of 
stuents (424 students from two grades), our experience with this 
district data set was similar to what could be expected for 
implemetation of the data base at a school level* 

The district data set was first partitioned by school 
resulting in two separate data sets, one for each school 
containing 272 and 15? students respectively* Each of these two 
school data sets was then partitioned further by variable into 
two data sets* At this point each of the two schools had two 
data sets, one containing achievement data, the other containing 
student background and questionnaire data* 

Finally, each of these four data sets (two per school) was 
partitioned based on the number of students* In the case of the 
larger school, each of the two data sets was divided into three 
data sets containing 100, 100 and 72 observations (resulting in a 
total of six data sets)* The smaller school's two data sets were 
each divided into two data sets containing 100 and 52 
observations (a total of four data sets)* 

An IBM AT was used for downloading* First, the micro- 
computer version of SAS is a large program requiring a hard disk 
for storage and a math coprocessor as well* Second, the AT was 
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equipped with a more powerful processor thereby increasing its 
processing speed. The A'^ was equipped with a high densisty 1.2 
megabyte disk drive. While PC's and XT's are equipped with the 
standard 360 Kbyte floppy drives, the 1.2 megabyte drive writes 
over three times the amount of data on a floppy diskette. 
However, we decided to use the standard 360K irive to allow for 
data use on a variety of micro's (PC, XT, or AT). The total data 
base required 17 diskettes. 

Another difficulty was the time required to download the 
data. The smallest data set, 98 observations, took over twenty 
minutes to download. Because we were using a modem, any 
disLurbance in the communication line resulted in a program crash 
and the download process would have to be re-initiated. 

The implications of this discussion for the implementation 
of a school-based micro-computer evaluation system are several. 
Most important is the need for early consideration of the use of 
the data. Will it be necessary to transfer the data to a 
district level system? If so, what variables are needed 
(Individual achievement test items scores versus a subscale total 
score)? Decisions in this area will automatically impact the 
size of the data set. Will teachers use the data base, and if so 
would smaller classroom data sets be desirable? 

Ultimately data stored on a hard disk system for current use 
will need to be downloaded for storage as the school year ends. 
Certain data, such as demographic information would remain intact 
while other data such as attendance and special program 
participation might be downloaded to floppy diskettes for 
storage. Other data, such as achievement test subscale scores 
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would be maintained for year-to-year tracking of student 
progress. The coll ap sing of the current data base and 
downloading of older data will require technical expertise w. ich 
may not be available at the school level. In these cases, care 
should be taken in choosing software which will be particularly 
user friendly with respect to data management and data base 
manipulation . 
Discusaton 

This paper has provided a brief overview of some of the 
complexities which presented themselves throughout the prototype 
development phase of the project. Because the project 
incorporated data from five school districts, this process was 
particularly complicated, and as indicated above, anticipated 
economies of scale failed to be realized. Based on this 
experience, we have identified some measures which should 
facilitate the smooth implementation of project such as this in 
the future. 

First and foremost considerations include hardware and 
software specifications* Developing a single micro-coraputer 
based evaluation system which can accomodate multiple settings 
and levels of analyses is a complex undertaking requiring custom 
designed, user friendly software. Hardware and software 
considerations should be closely coordi..ated with the 
identification of information needs phase of the project. The 
individuals who will be compiling and analyzing the data base 
should be consulted early in the planning phase of the project. 
Among our recomendations are the following: 
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1. Avoid overestimating the technical expertise and sensitivity 
of the planned system users. A school-based system with rapid 
turnaround requirements will probably require ^^^hat data 
collection, input and analysis be handled at the sch ol level. 
Technical expertise in these areas may be limited. 

2. As a corollary to the above, be sure to build in ample 
safeguards to assure the integrity of the data; providing 
directions is insufficient. It will be necessary to incorporate 
data verification procedures into input routines to check for out 
of range values, non-existant identification codes, and other 
data input errors. Automated entry options may also help sustain 
data quality. For example, if instrumentation utilizes scant ron 
technology, one serious source of error, resulting in time 
consuming data cleaning procedures, may be reduced. In any 
event, the need to carefully monitor data entry and to build in 
reliability and accuracy checks during the input process is well 
demonstrated in our experience. 

3. The technical expertise (or lack thereof) of local users also 
suggests the need for safeguards against potential misuse of data 
and drawing conclusions that are not warranted by available data, 
(e.g., drawing conclusions related to ethnicity or socio-economic 
status based on very small numbers of students). 

4. Also related to both use of the data and potential levels of 
technical expertise, users will require a great deal of support 
in reading and interpreting the resulting reports. Issues such 
as headings, clarity of variable and instrument labels are more 
important than often anticipated. The graphics capability of the 
software used to develop the multilevel system is therefore an 
important selection factor. 

5. Processing time required for analysis and report production 
tend to be underestimated. Even at the school level, it is 
likely that data sets will be relatively large in both numbers of 
students and specific variables. A school-based system will 
generally require powerful microprocessors, as well as a great 
deal of patience, if SAS-PC, BMDP, SPSS or other similar micro- 
computer statistical analysis systems are used, special mathco- 
processors may be required to allow for more than very basic 
types of analyses. in any case, the generation of instant 
reports, given available school resources, probably will not be a 
short-term reality. 

6. The development of a generic softw; :e system in the face of 
differences In instrumentation (e.g., standardized tests), 
identification coding strategies, and variable definition is an 
ambitious goal. Experience has demonstrated that each school or 
district may require "Ither customized adaptation or an entirely 
new system specially designed to fit their needs. We found that 
our anticipated economies of scale were unrealistic »• that each 
site required a more individualized approach. 

While we experienced a number of problems, we remain 
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optimistic that the careful examination of these considerations, 
the early involvement of those who will construct the data base 
and those who will ultimately use it on a regular basis, and the 
careful coordination and monitoring of data collection will 
facilitate the process of development and implementation of 
useful multi-level evaluation systems. 
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DOCUMENTATION OF PROTOTYPE SOFTWARE 
FOR IMPLEMENTING THE SYSTEM 



(c) Rights of Repents, University of California, 1987. 
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PROGRAM STRUCTURE 
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** 



** Program: main 



** 
** 



** 
** 



Use: sets up files used £or Penn data base 



Programmer: Richard G. Feifer Sen Qi 
** 

*********** ************ ********* 



public this_yr last_yr 
public dbg 
dbg = .t. 
select 1 

use students alias studs 
set index to students, studs_num 

select 2 

use att_subj alias subj 
set index to att_subj 

select 3 

use att_sch alias sch 
set index to att_sch 

select 4 

use achievem alias ach 
set index to achievem 

* COMPUTE THE VARIABLE THIS_YR, THE DATE OF THE LAST TEST 

this^yr = iif (month(date( ) )^7, year (date( )) -1902, year (date( )) -1901) 

last_yr = this_yr -1 

do mainjnen && RUN MENU TO CHCX)SE TYPE OF REPORT 
return 



&& OPEN MAIN DATABASES A>ID ASSIGN 
&& EACH TO A WORK AREA 
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* Prcgrarn. 

* Author . . 

* Date 



MAIN_MEN.PRG 

SEN QI RICHABD 3. FEIFER 
12/22/86 

Copyright (c) 1986, All Rights Reserved 



* Notice . . 

* Notes... 



* Reserved 



seltictnum 



SET TALK OFF 
SET BELL OFF 
SET STATUS ON 
SET ESCAPE OFF 
SET CONFIRM ON 

DO WHILE .T. 

* Display menu options, centered on the screen. 

* draw menu border and print heading 
CLEAR 

e 2, 0 TO 13,79 DOUBLE 

e 3,19 SAY [CHOOSE TYPE OF REPORT:] 
e 4,1 TO 4,78 DOUBLE 

* display detail lines 

e 7,29 SAY [1. STUDENT AT A GLANCE] 

e 8,29 SAY [2. TEST SCORES OVER TINE] 

e 9,29 SAY [3. COMPARISON AMONG GROUPS] 

e 11, 29 SAY '0. EXIT' 

STORE 0 TO selectnum 

% 13 33 SAY " select " 

e 13*42 GET selectnum PICTURE "9" RANGE 0,3 
BEAD 

DO CASE 

CASE selectnum = 0 
SET BELL ON 
SET TALK ON 
CLEAR ALL 
RETURN 

CASE selectnum = 1 

* DO Student at a glance 
do roster 

SET CONFIRM OFF 

STORE • • TO wait_subst 

% 23,0 SAY 'Press emy key to continue...' GET wait_subst 
READ 

SET CONFIRM ON 

CASE selectnum = 2 

* DO Test scores over time 
do choose_fd.pr9 

SET CONFIRM OFF 

STORE ' ' TO wait_subst 

6 23,0 SAY 'Press any key to continue...' GET wait_subst 
READ 
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SET CONFIKM ON 



CASE selectnum = 3 

* DO Comparison 2unong groups 

do choose_gp.prg 

SET CONFIRM OFF 

STORE ' ' TO wait_subst 

§ 23,0 SAY 'Press any key to continue...' GET wait subst 
READ 

SET CONFIRM ON 

ENDCASE 

ENDDO T 
RETURN 

* EOF: MAIN MEN.PRG 
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** 
** 
** 
** 
** 
** 
** 

**************************4r*********ill ****************** ******* 



Program: Roster 

Use: Prints "students at a Glance" 
Programmer: Richard G. Feifer Sen Qi 



set echo off 
set talk off 

set procedure to list_proc 
clear 

store 'N* to lis 

% 12,2 say "Teacher? (want a list?)*' get lis 
read 

if upper(lis) = 'Y* 
clear 

do get_list 

wait 
endif 
clear 

accept 'Which teacher? * to mtoacher 
select studs 

set filter to teacher = mteacher 
go top 

accept 'Hard copy; ' to mhc 
rahc = ipper(left(mhc^l)) 
hard = iif(mhc =*Y* , . t. , .f . ) 
if hard 

set print on 

set device to printer 
endif 
clear 

? 'STUDENTS AT A GLANCE* 
? 'Teacher: '. mteacher , * 



dateO 



? 
? 
? 
? 
? 
? 
? 

? * 

line num ^ 0 
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* Loop for each student 
do while .not. eof() 

line_num = line_num + 1 

? stud_num , ' ' 

mname =lef t( trim(Lname)+' , •+fname,15) 
?? mname 

V? space( 17-len(mname) ) 
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&& Increment line number 
Set variable for name 
&& space over to 17th column 



?? grade 

* Print special programs 
rasp = iif (spl, 'G' , ' ' ) 

rasp = iif (sp2^rasp+'T' ^rasp) 
rasp = iif (sp3^rasp+'l' ^msp) 
rasp = iif(len(rasp) < l,'.',rasp) 
?7 ' '+rasp 

?? space(4-len(trim(msp) ) ) 

* Print Data 
?? att abs rt 

select ach 

ach_found = .f . 

do find_rec with ach_found 

V? iif (ach_foiind,str(ratper,2),' *') 

?? ' ' 

select subj 

s\ibj_found = .f. 

do find_rec with subj^found 

7? iif(subj_found,str(r_overall,3,l),' *') 

?? • • 

?? iif (ach_found,str(ach->rtper,2) , ' *') 
?? • ' 

?? iif(subj found, str(ra overall, 3,1),' *') 
?7 • ' 

?? iif(s\xbj found, strCamt hw,3,l),' *') 
?? ' • " 

?? iif (subj found,str(frqparAlp,3,l) , ' *' ) 
?? • • 

7? iif (subj _found,str( pr^sup, 3,1),' *') 
select studs 

if line_num / 5 = int( liiie_nura/5) 

? && Skip a line if after 

endif && the 5th name 

skip 

enddo && End of main loop 

if hard 
eject 

set print off 

set device to screen 
set filter to 
return 
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********************************* 
** 

** Program: List proc 

** 

** Use: Print List of Teachers 

** 

** Programer: Sen Qi 

** 

**************************************** 



procedure get_list 
select 1 

set index to teacher 
list off teacher 

set index to students, studs_num 
return 
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************************************* 
** 

** Program: find rec 
** 

** Use: Finds the record for the current student for 

** the current year 

** 

** Progranimer : Richard G. Feifer 
** 

************************************************************** 

parameters found 
go^ top 

seeJc studs ->stud_num 

do while .not. eof() .and. stud_num = studs- >stud_num .and. .not. found 
if year = this_yr 

found = .t. 
else 

skip 
endif 
enddo 
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* Program..: CHOOSE__FD . PRG 

* Author...: RICHARD G. FEIFER 

* Date : 09/25/86 

* Notice...: Copyright (c) 1986, RICHARD G. FEIFER, All Rights Reserved 

* Notes . . . . : 

* Reserved. : selectnum 
* 

* MENU WHICH ALLOWS THE USE TO CHOOSE WHICH FIELD IS DESIRED 

* FOR REPORT 



SET TALK OFF 

SET BELL OFF 

SET STATUS ON 

* SET ESCAPE OFF 

SET CONFIRM ON 

set procedure to bar_proc 



DO WHILE .T. 



* Display menu options, centered on the screen. 

* draw menu border and print headina 
CLEAR 

e 2, 0 TO 18,79 DOUBLE 

@ 3,18 SAY [CHOOSE FIELD TO COMPARE] 
e 4,1 TO 4,78 DOUBLE 

* display detail lines 

e 7,34 SAY [1. Reading 1] 
6 8,34 SAY [2. Reading 2] 
e 9,34 SAY [3. Reading 3] 

e 10,34 SAY [4. Reading Total] 

e 11,34 SAY [5. Math 1] 

e 12,34 SAY [6. Math 2] 

a 13,34 SAY [7. Math 3] 

e 14,34 SAY [8. Math Total] 

e 16, 34 SAY '0. EXIT' 

STORE 0 TO selectnum 

e 18,33 SAY " select 

e 18,42 GET selectnum PICTURE "9" RANGE 0,8 
READ 

DO CASE 

CASE selectnum = 0 
SET BELL ON 
SET TALK ON 
RETURN 



CASE selectnum = 1 
* DO Reading 1 

mfield = 'rl' 

do bar__chart with mfield 

SET CONFIRM OFF 

STORE ' ' TO wait_subst 

8 23,0 SAY 'Press any key to continue...' GET wait subst 
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READ 

SET CONFIRM ON 



CASE selectnum = 2 

* DO Reading 2 
mfield = 'r2' 

bar_chart with mfield 
SET CONFIRM OFF 
STORE ' ' TO wait_subst 

% 23,0 SAY 'Press any key to continue...' GET wait subst 
READ 

SET CONFIRM ON 

CASE selectnum = 3 

* DO Reading 3 
mfield = 'r3' 

do bar_chart with mfield 

SET CONFIRM OFF 

STORE ' ' TO wait_subst 

§ 23,0 SAY 'Press any key to continue...' GET wait_subst 
READ 

SET CONFIRM ON 

CASE selectnum = 4 

* DO Reading Total 
mfield = 'rt' 

do bar chart with mfield 

SET CONFIRM OFF 

STORE ' ' TO wait_subst 

% 23,0 SAY 'Press any key to continue...' GET wait iibst 
READ 

SET CONFIRM ON 

CASE selectnum = 5 

* DO Math 1 
mfield = 'ml' 

do bar_chart with mfield 

SET CONFIRM OFF 

STORE ' ' TO wait_subst 

% 23,0 SAY 'Press any key to continue...' GET wait subst 
READ ~ 
SET CONFIRM ON 

CASE selectnum = 6 

* DO Math 2 
mfield = 'm2' 

do bar chart with mfield 

SET CONFIRM OFF 

STORE ' ' TO wait_subst 

e 23,0 SAY 'Press any key to continue...' GET wait subst 
READ 

SET CONFIRM ON 

CASE selectnum = 7 

* DO Math 3 

51 
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mfield = 'ra3' 

do bar_chart with mfield 

SET CONFIRM OFF 

STORE ' ' TO wait_subst 

e 23,0 SAY 'Press any key to continue...' GET wait subst 
READ 

SET CONFIRM ON 

CASE selectnum = 8 
* DO Math Total 

mfield =- 'mt' 

do bar_chart with mfield 

SET CONFIRM OFF 

STORE ' ' TO wait_subst 

e 23,0 SAY 'Press any key to continue...' GET wait subst 
READ 

SET CONFIRM ON 

ENDCASE 

ENDDO T 
if dbg 

? 'l*iaving choose_f .prg' 
endif 
RETURN 

* EOF: CHOOSE FD.PRG 
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*********************************************** 

** 

** Program: Bar graph program 
** 

** Use: Generate a bar graph for supplied field 

** comparing 2 years. 

** 

** Programmer: Richard G. Feifer Sen Qi 
** 

*************************** ********************************** 

************** **********************************************^^ 

* MAIN BAR PROCEDURE 

* CALLS SUBROUTINES 
procedure bar_chart 

parameters mfield 
set escape on 
do case 

case mfield = ' rl ' 
mname = 'Reading 
max = 20 
key = 'per 20a' 
case mfield = 'r2' 
mname = 'Reading 
max = 20 
key = 'per 20b' 
case mfield = ' r3 ' 
mname = 'Reading 
max = 45 
key = 'per45' 
case mfield = 'rt' 

mname = 'Total Reading Score ' 
max = 85 
key = 'per85' 
case mfield = 'ml' 

mname = 'Math Score 1 ' 
max = 30 
key = 'per 30' 
case mfield = 'm2' 

mname = 'Math Score 2 ' 
max = 15 
key = 'perlj' 
case mfield = 'm3 ' 

mname = 'Math Score 3 ' 
max = 72 
key = 'per 72' 
case mfield = 'mt' 

mname = 'Total Math 3core ' 
max = 117 
key = 'perll7' 
otherwise 

mname = 'Selected Field' 
endcase 



&& DETERMINE THE TITLE AND MAXIMUM 
&& FOR RAW SCORES 
Score 1 ' 

&& THE KEY FOR NOW DOES NOT DIFFERENTIATE 
&& GRADE. ACTUAL VERSION WILL HAVE TO SE^ 
&& THE KEY ONCE GRADE AND TEST ARE CHOSEN. 

Score 2 ' 



Score 3 
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* SET DEFAULT VALUES FOR VARIABLES 
rarfield ~ mfield+' raw' 
mpfield = mfield+'per' 

this_yr = iif (month(date( ) )<7 , year (date( )) -1902, year (date( )) -1901 ) 

last_yr = this_^r -1 

mrtotall = 0*00 

mrtotal2 = 0.00 

nl =0 

n2 = 0 

rarvHvel = 0.00 
rarave2 = 0.00 
raptot^\ll = 0.00 
raptota.l2 = 0.00 
mpavel =0.00 
mpave2 =0.00 
store 'N' to ans 

store 'N' to lis && ASK USER FOR REPORT PARAMETERS 

store 'ALL ' to mteacher 

store ' ' to mgrade 

@ 10,2 say "Hard Copy?" get ans 

9 12,2 say "Teacher? (want a list?)" get lis 

read 

if u]rper(lis) ='Y' 
clear 

do get_list 
endif 

e 13,2 sa "Teacher?" get mteacher 
9 14,2 sa^ 'Grade? " get mgrade 
read 

mteacher = crim ( mteacher ) 
if mteacher = 'ALL' 

chk_tch = .f . 
else 

chk_tch = .t. 
endif 

if upper (ans) ='Y' 

hard = .t. 
else 

hard = .f • 
endif 

do get_data 
if hard 

set print on 
endif 



* PRINT REPORT 
do p_head 
do printer aw 

do p_bars with 'Raw Scores S mravel, mrave2, max 
do p_bars with 'Percentiles', mpavel, mpave2, 100 
if hard 
eject 

set print off 
endif 
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return 



*********** A* ********************** ****** ********* 

* SHOW THE LIST OF THEACHERS AND GRADES 
Procedure get_list 

select 1 

set index to teacher 

list off teacher, grade 

set index to students^ studs_num 

return 

**********************************:li****************** 

* PRINT BAR CHART HEADING 
Procedure p_head 

clear 

? 

? 

? * Comparison of Test Scores' 

? ' • 

?? iif(chk_tch, 'Teacher: •+inteacher /District Wide') 

? • '+str(last_yr,2)+' - '+str(this yr,2) 

? 

? ' Grade: 'i- ade 

? • ' +mname 

7 

? 
? 

return && Print Heading 



&& 
&& 
&& 
&& 



********************************************^. X******** 

* COLLECT AND TOTT^ THE DATA 

Procedure get_data 
select studs 
set index to studs_num 
selec subj 

set relation to stud_num into studs 
select ach 

set relation to stud_num into studs 
select sch 

set relation to. stud^nuun into studs 
select ach 
go top 

the grade = val(mgrade) 
do while .not. eof() 
if .not. chk_tch .or. studs- > teacher 
do case ^ 

case year = this_yr 

nl = iif (&inrf ield>0,nl+l,nl) 
mrtotall = mrtotall + fimrfield 
case year = last_yr 

n2 = iif (fimrfield >0,n2+l,n2) 
mrtotdl2 = inrtotal2 + fimrfield 

endcase 



SET RELATIONS SO THAT 
STUDENT INFORMATION IS 
AVAILABLE FOR WHATTWER 
RECORD IS BEING LOOKED AT 



&& STEP THR JGH THE RECORDS 
mteacher .and. studs- >grade = the 
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endi£ 

skip 
enddo 
clear 

mravel = mrtotall/nl 

iiirave2 = mrtotal2/n2 

do findper with mpavel, mravel 

do findper with mpave2,mrave2 

select studs 

set index to students 

return && from get^data 



************************************************* 

* LOOKS UP THE PERCENTILE SCORE FOR A GIVEN RAW SCORE 
Procedure findper 

parameters mperc, mraw 
select 6 

use &key index &key 
seek int(mraw) 
mperc = per 

USE && CLOSE THE KEY FILE 

return 



*********************************************************** 

* PRINT A BAR OF THE APPROPRIATE LENGTH 
Procedure stars 

parameters yr^niim, max 
yrstr = str(yr,2) 
nxm = int(num) 
? yrstr+' | • 

right = num * (70 /max) && COMPUTE THE NUMBER OF SPACES 

mcount =1 && NEEDED T<) REPRESENT NUM 

do while mcount <= right 

?V SlSl PRINT APPROPRIATE NUMBER OF SPACES 

recount = recount +1 
enddo 

O » If 

* I 
recount = 1 

dr while recount <= right 
?? 

:acount = recount + 1 
enddo 
return 



************************************* *******i^* ************** 

* PRINT BOTTOM OF BAR CHART 
procedure bottom 

parameters reax 
? ' 0' 
interval = 1 
do while interval < 4 

?? space (14) 
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?? str( interval * (raax/4),4,l) 
Interval = interval + 1 
enddo 

?? space (14) 

?? str( interval * (max/4),3) 
return 



******** ********* 

* PRINT INDIVIDUAL BAR CHART 
proc^^ure p_bars 

parameters title, first, second, max 

? 
? 

? ' •+title 

? • }• 

do stars with last_yr, first, max 

91 II 

do stars with this_yr, second, max 

91 II 

91 II 

? ' + + + + 

do bottom with max 
return 

********************************************************* 

* PRINT DATA IN TEXT FORM ON A BAR REPORT 
Procedure print_raw 

? 'Total nu.TLber of students wi ,h data for 19'+str( this_yr,2) + ' : •+str(nl,3) 

? 'Average Raw score: '+str(niravel,5,2) 

? 'Average Percentile score: '+str(mpavel,5,2) 

? 

? 'Total number of students with data for 19'+str(last_yr,2)+' : '+str(n2,3) 

? 'Average Raw score: '+str(mrave2,5,2) 

? 'Average Percentile score: '+str(mpave2,5,2) 

? 

return 
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* Program..: CHCX)SE__GP . PRG 

* Author . . . : QI SEN 

* Date : 01/12/87 

* Notice...: Copyright (c) 1987, QI SEN, All Rights Reserved 

* Notes . . . . : 

* Reserved. : selectnum 



SET TALK OFF 
SET BELL OFF 
SET STATUS ON 
SET ESCAPE OFF 
SET CONFIRM ON 



DO WHILE .T. 



* Display menu options, centered on the screen. 

* draw menu border and print heading 
CLEAR 

e 2, 0 TO 13,79 DOtJBLE 

9 3,16 SAY [CHOOSE TYPE OF COMPARISON] 
9 4,1 TO 4,78 DOUBLE 

* display detail lines 

9 7,28 SAY [1. AMONG ETHNIC GROUPS] 

9 8,28 SAY [2. AMONG SPECIAL PROGRAMS] 

9 9,28 SAY [3. BETWEEN SEXES] 

e 11, 28 SAY '0. EXIT' 

STORE 0 TO selectnum 

9 13,33 S^Y " select " 

9 13,42 GET selectnum PICTURE "9" RANGE 0,3 

READ 



DO CASE 

CASE selectnum = 0 
SET BELL ON 
SET TALK ON 
CLEAR ALL 
RETURN 



CASE selectnum = 1 

* DO AMONG ETHNIC GROUPS 

DO CH00SE1_FD.PRG 

SET CONFIRM OFF 

STORE ' ' TO wait_subst 

9 23,0 SAY 'Press any key to continue...' GET wait siibst 
READ 

SET CC^TiRM ON 



CASE selectnum = 2 

* DO AMONG SPECIAL PROGRAMS 

DO CH00SE2__FD.PRG 

SET CONFIRM OFF 

STORE ' ' TO wait_subst 

9 23,0 SAY 'Press any key to continue...' GET wait subst 
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READ 

SET CONFIRM ON 



CASE selectnum = 3 
* DO BETWEEN SEXES 

DO CH00SE3_FC.PRG 

SET CONFIRM OFF 

STORE ' ' TO wait_subst 

e 23,0 SAY 'Press any key to continue...' GET wait subst 
READ 

SET CONFIRM ON 

ENDCASE 



ENDDO T 
RETURi« 

* EOF: CHOOSE Gt.PRG 



ERIC 
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* Program 

* Author. 

* Date. . . 

* Notice. 

* Notes.. 

* Reserved 
* 



CK00SE1_FD.PRG 
QI SEN 
12/22/86 

Copyright (c) 1986, QI SEN, All Righ 
selectnum 



Reserved 



MENU WHICH ALLOWS THE USE TO CHOOSE WHICH FIELD IS DESIRED 
FOR REPORT 



SET TALK OFF 

SET BELL OFF 

SET STATUS ON 

* SET ESCAPE OFF 

SET CONFIRM ON 

set procedure to bar_l 

DO WHILE .T. 

* Display menu options, centered on the screen. 

* draw ipenu border and print heading 
CLEAR 

e 2, 0 TO 18,79 DOUBLE 

e 3,18 SAY [CHOOSE FIELD TO COMPARE] 
e 4,1 TO 4,78 DOUBLE 

* display detail lines 

e 7,34 3AY [1. Reading 1] 
0 8,34 SAY [2. Reading 2] 
0 9,34 SAY [3. Reading 3] 

0 10,34 SAY [4. Reading Total] 

0 11,34 SAY [5. Math 1] 

% 12,34 SAY [6. Math 2] 

9 13,34 SAY [7. Math 3] 

0 14,34 SAY [8. Math Total] 

9 16, 34 SAY '0. EXIT' 

STORE 0 TO selectnum 

e 18,33 SAY " selec. " 

e 18,42 GET selecLnum PICT^IRE "9" RANGE 0,8 
READ 

DO CASE 

CASE selectnum = 0 
SET BELL ON 
SET TALK ON 
RETURN 

CASE selectnum = 1 
* DO Reading 1 

mfield = 'rl' 

do graph with mfield 

SET CONFIRM OFF 

STORE ' ' TO wait_subst 

e 23,0 SAY 'Press any key to continue...' GET wait subst 
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READ 

SET CC3NFIRM ON 

CASE selectnum = 2 

* DO Reading 2 
rcf:.eld = •r2' 

do grf^ph with mf ield 

SET CONFIRM OFF 

STORE ' ' TO wait_subst 

% 23,0 SAY 'Press any key to continue...* GET wait subst 
READ 

SET CONFIRM ON 

CASE selectnum = 3 

* DO Reading 3 
mfield = •r3' 

do graph with mfield 

SET CONFIRM OFF 

STORE ' ' TO wait_subst 

e 23,0 SAY 'Press any key to continue...' GET wait subst 
READ 

SET CONFIRM ON 

CASE selectniui = 4 

* DO Reading Total 
mfield = 'rt' 

do graph with mfield 

SET CONFIPJl OFF 

JTORE ' ' TO wait_subst 

% 23,0 SAY 'Press any key to continue...' GET wait subst 
READ 

SET CONFIRM ON 

CASE selectnu-n = 5 

* DO Math 1 
mfield = 'ml' 

do graph with mfield 

SET CONFIRM OFF 

STORE ' ' TO wait_subst 

e 23,0 SAY 'Press ?.ny key to continue...' GET wait subst 
READ 

SET CONFIRM ON 

CASE selectnum = 6 

* DO Math 2 
mfield = 'm2' 

do graph with mfield 

SET CONFIRM OFF 

STORE ' ' TO wait_subst 

e 23,0 SAY 'Press any key to continue...' GET wait subst 
READ 

SET CONFIRM ON 

CASE selectnum = 7 

* DO Math 3 
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mfipld = 'mS' 

do graph with mfield 

SET CONFIRM OFF 

STORE • • TO wait_subst 

e 2?,0 SAY 'Press any key to continue...' GET wait_subst 
READ 

SET CONFIRM ON 

CASE selectnum = 8 
* DO Math Total 

mfield = 'mt' 

do graph with mfield 

SET CONFIRM OFF 

STORE ' ' TO wait_subst 

8 23,0 SAY 'Press any key to continue...' GET wait subst 
READ 

SET CONFIRM ON 

ENDCASE 



ENDDO T 
RETURN 

* EOF: CHOOSE FD.PRG 



ERIC 
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* 
* 
* 
* 
* 
* 
* 
* 
* 



Progreun 
Author . 
Date . . . 
Notice . 
Motes . . 
Reserved 



CH00SE2_FD.PRG 
QI SEN 
03/30/87 

Copyright (c) 1987, QI SEN, All Rights Reserved 
selectnum 



MENU WHICH ALLOWS THE USE TO CHOOSE WHICH FIELD IS DESIRED 
FOR REPORT 



SET TALK OFF 

SET BELL OFF 

SET STATUS ON 

* SET ESCAPE OFF 

SET CONFIRM ON 

set procedure to bar_2 

DO WHILE .T. 



* Display menu options, centered on the screen. 

* draw menu border and print heading 
CLEAR 

e 2, 0 TO 18,79 DOUBLE 

§ 3,18 SAY [CHOOSE FIELD TO COMPARE] 
§ 4,1 TO 4,78 DOUBLE 

* display detail lines 

e 7,34 SAY [1. Reading 1] 
e 8,34 SAY [2. Reading 2] 
e 9,34 SAY [3. Reading 3] 

e 10,34 SAY [4. Reading Total] 

e 11,34 SAY [5. Math 1] 

e 12,34 SAY [6. Math 2] 

e 13,34 SAY [7. Math 3] 

e 14,34 SAY [8. Math Total] 

€ 16, 34 SAY '0. EXIT' 

STORE 0 TO selectnum 

e 18,33 SAY " select 

§ 18,42 GET selectnum PICTURE "9" RANGE 0,8 
READ 



DO CASE 

CASE selectnum = 0 
SET BELL ON 
SET TALK ON 
RETURN 



CASE selectnum = 1 
* DO Reading 1 

mfield = 'rl' 

do graph with mfield 

SET CONFIRM OFF 

STORE • ' TO wait^subst 

% 23,0 SAY 'Press any key to continue...' GET wait subst 



ERIC 
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READ 

SET CONFIRM ON 



CASE selectniun = 2 

* DO Reading 2 
mfield = 'r2' 

do graph with mfield 

SET CONFIRM OFF 

STORE • ' TO wait_subst 

% 23,0 SAY 'Press any key to continue...' GET wait_subst 
READ 

SET CONFIRM ON 

CASE selectniun = 3 

* DO Reading 3 
mfield = •r3' 

do graph with mfield 

SET CONFIRM OFF 

STORE ' ' TO wait_subst 

e 23,0 SAY 'Press any key to continue...' GET wait si'Jast 
READ — 
SET CONFIRM ON 

CASE selectnum = 4 

* DO Reading Total 
mfield = 'rt' 

do graph with mfield 

SET CONFIRM OFF 

STORE ' ' TO wait_subst 

@ 23,0 SAY 'Press any key to continue...' GET wait subst 
READ 

SET CONFIRM ON 

CASE selectniun = 5 

* DO Math 1 
mfield = 'ml' 

do graph with mfield 

SET CONFIRM OFF 

STORE ' ' TO wait_subst 

e 23,0 SAY 'Press any key to continue...' GET wait_subst 
READ 

SET CONFIRM ON 

CASE selectniun = 6 

* DO Math 2 
mfield = 'm2' 

do graph with mfield 

SET CONFIRM OFF 

STORE ' ' TO wait_subst 

@ 23,0 SAY 'Press any key to continue...' GET wait subst 
READ 

SET CONFIRM ON 

CASE selectnum = 7 

* DO Math 3 
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..field = 'mS' 

do graph with mfield 

SET CONFIRM OFF 

STORE ' ' TO wait_subst 

@ 23,0 SAY 'Press any key to continue...' GET wait subst 
SET CONFIRM ON 



CASE selectniim = 8 
* DO Math Total 

mfield = 'mt' 

do graph with mfield 

SET CONFIRM OFF 

STORE ' ' TO wait_subst 

e 23,0 SAY 'Press any key to continue...' GET wait subst 
READ 

SET CONFIRM ON 

ENDCASE 



ENDDO T 
RETURN 

* EOF: CH00SE2 FD.PRG 
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* Program..: CHOOSE 3_FD.i' AG 

* Author...: QI SEN 

* Date : 01/26/87 

* Notice...: Copyright (c) 1987, QI SEN, All Rights Reserved 

* Notes....: 

* Reserved.; selectnum 

* MENU WHICH ALLOWS THE USE TO CHOOSE WHICH FIELD IS DESIRED 

* FOR REPORT 



SiiT TALK OFF 

SET BELL OFF 

SET STATUS ON 

* SET ESCAPE OFF 

SET CONFIRM ON 

set procedure to bar_3 

ro WHILE .T. 

* Display menu options, centered on the screen. 

* draw menu border and print heading 
CLEAR 

e 2, 0 TO 18,79 DOUBLE 

83, 18 SAY [CHOOSE -lELD TO uOMPARE] 
@ 4,1 TO 4,78 DOUBLE 

* display detail lines 

@ 7,34 SAY [1. Reading 1] 
@ 8,34 SAY [2. Reading 2] 
@ 9,34 SAY [3, Reading 3] 

@ 10,34 SAY Reading Total] 

e 11,34 SAY f. Math 1] 

e 12,34 SAY Ld. Math 2] 

@ 13,34 SAY [7. Math 3] 

@ 14,34 SAY [8. Math Total] 

e 16, 34 SAY '0. EXIT' 

STORE 0 TO selectnum 

e 18,33 SAY " select 

@ 18,42 GET selectnum PICTURE "9" RANGE 0,8 
READ 

DO CASE 

CASE selectnum = 0 
SET BELL ON 
SET TALK ON 
RETURN 

CASE > lectnum = 1 
* DO Reading 1 

mfield = 'rl' 

do graph with mfield 

S-T CONFIRM Ci-F 

STORE ' ' TO wait_subst 

9 23,0 SAY 'Press any key to continue...' GET wait subst 



id 

ERIC 
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READ 

SET CONFIRM ON 



CASE selectnum = 2 

* DO Reading 2 
mfield = 'r2' 

do graph with mfield 

SET CONFIRM OFF 

STORE ' ' TO wait_s\ibst 

e 23,0 SAY 'Press any key tc continue...' GET wait subst 
READ 

SET CONFIRM ON 

CASE selectnum = 3 

* DO Reading 3 
mfield = 'r3' 

do graph with mfield 

SET CONFIRM OFF 

STORE ' ' TO wait_subst 

e 23,0 SAY 'Press any key to continue...' GET wait subst 
READ 

SET CONFIRM ON 

CASE selectnuta = 4 

* DO Reading Total 
mfield = 'rt' 

do graph with mfield 

SET CONFIRM OFF 

STORE ' ' TO vait_subst 

0 23,0 SAY 'Press any key to continue ' GET wait subst 

READ — 
SET COKFIRM ON 

CASE selectnum = 5 

* DO Math 1 
ipfield = 'ml' 

do graph with mfiell 

SET CONFIRM OFF 

STORE ' ' TO wait_subst 

0 2Z,Q SAY 'Press any key to continue ' GET wait subst 

READ 

SET CONFIRM ON 

CASE selectnum = 6 

* DO Math 2 
mfield = 'm2' 

do graph with mfield 

SET CONFIRM OFF 

STORE ' ' TO wait_subst 

0 23,0 SAY '^re'-s any key to continue..,' GET wait subst 
READ 

SET CONFIRM ON 

CASE selectnum = 7 

* DO Math 3 



ER?C '""'^^ 70 



mfield = 'mS' 

do graph with mfield 

SET CONFIRM OFF 

STORE ' ' TO wait_subst 

e 23,0 SAY 'Press any key to continue...' GET wait subst 
READ 

SET CONFIRM ON 

CASE selectnum = 8 
* DO Math Total 

mfield = 'mt' 

do graph with mfield 

SET CONFIRM OFF 

STORE • ' TO wait_subst 

e 23,0 SAY 'Press any key to continue...' GET wait subst 
READ 

SET CONFIRM ON 

ENDCASE 



ENDDO T 
RETURN 

* EOF: CH00SE3 FD.PRG 



ERIC 
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*********************************************************** 
** 

** Program: Bar graph program I 
** 

** Use: Generate a bar graph for supplied field 

** comparing among ethnic groups, 

** 

** Programmer: Qi Sen 
** 

************************************************************** 



******************************* **4***********-^ **************** 

* MAIN BAR PROCSDURE 

* CALLS SUBROUTINES 
procedure graph 

parameters mfield 
set escape on 

do case && DETERMINE THE TITLE AND MAXIMUM 

casa mfield = 'rl' && FOR RAW SCORES 

mname = 'Reading Score 1 * 

max = 20 
case mfield = * r2* 

mname = 'Reading Score 2 * 

max = 20 
case mfield = 'r3' 

mname = 'Reading Score 3 * 

max = 45 
case mfield = 'rt' 

mname - * Total Reading Score * 

max = 85 
case mfield = *ml* 

mname = *Math Score 1 * 

max = 30 
case mfield 'm2' 

mname = 'Math Score 2 ' 

max = 15 
case mfield = 'm3' 

mname = 'Math Score 3 ' 

max = 72 
case mfield = 'mt' 

mname = 'Total Math Score ' 

max = 117 
otherwise 

mname = 'Selected Field' 
endcase 

* SET DEFAULT VALUES FOR VARIABLES 
ethnic = 0 

mpfie-.d = mfield+'per' 
nl = 0 
n2 = 0 
n3 = 0 
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n4 - 0 
n5 = 0 



n1 1 




n 


nx ^ 




1 


n1 1 




n 


n^l 




n 






n 


•J 


_ 


n 
\j 






0 






0 


n33 




0 


n41 




0 


n42 




0 


n43 




0 


n51 




0 


n52 




0 


n53 




0 



npll = u 
npl2 = 0 
npl3 = 0 
np21 = 0 
np22 = 0 
np23 = 0 
np31 = 0 
np32 = 0 
np33 = 0 
np41 = 0 
np42 = 0 
np43 = 0 
np51 = 0 
np52 = 0 
np53 = 0 
pll = 0.00 
pl2 = 0.00 
pl3 =0.00 
p21 = 0.00 
p22 = 0.00 
p23 = 0.00 
p31 = 0.00 
p32 = 0.00 
p33 = 0.00 
p41 = 0.00 
p42 = 0.00 
p43 = 0.00 
p51 = 0.00 
p52 = 0.00 
p53 = 0.00 

store '84' to msyear 
store 'c6' to meyear 

store 'N' to ans && ASK USER FOR REPORT PARAMETERS 

store ' ' to mgrade 

store '50' to mper 

% 6,2 say "Hard Copy? " get ans 

e 8,2 say "Grade? " get mgrade 

e 10,2 say "From Year? " ge*: msyear 



IV-30 



73 



8 12r2 say "To Year? " get meyear 
e 14,2 say "Percentile?" get mper 
read 

if upper (ans) ='Y' 

hard = .t. 
else 

hard = 
endi£ 

do get_data 



♦PRINT REPORT 
if hard 

set device to print 

do p_print 

eject 

set device to screen 
else 

set color on 

set status off 

do p_head 

wait 

clear 

do p_xaxis 

do p_yaxis 

do p^show 

wait " " 

set status on 

set color to w/b 
*endif 
return 



*********** 

♦COLLECT AND TOTAL THE DATA 
Procedure get_data 
select studs 



&& 
&& 
&& 
&& 



SET RELATIONS SO THAT 
STUDENT INFORMATION IS 
AVAITABLE FOR WHATEVER 
RECORD IS BEING LOOKED 



set index to studs^iium 
select subj 

set relation to stud_num into stuxs 
select ach 

set relation to stud_num into studs 
select sch 

set relation to stud^num into studs 
select ach 
go top 

vgrade = val(mgrade) 
vmper = val(mper) 
do while .not^ eofO 
if studs->grade = 
do case 

case ach->year 
do case 

case studs- >ethnic = 1 

npll -= iif (&inpfield>vmper,npll+l,npll) 
nil = iif (&inpfield>=0,nll+l,nll) 
pll = npll/nll 



AT 



vgrade 

= val(msyear) 



&& STEP THROUGH THE RECORDS 
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case studs->ethnic = 2 

np21 = iif (&rapfield>vraper,np21+l,np21) 
n21 = iif (&mpfield>=0,n21+l,n21) 
p21 = np21/n21 

case studs- >ethnic = 3 

np31 = iif (&inpfield>vraper,np31+l,np31) 
n31 = iif (&inpfield>=0,n31+l,n31) 
p31 - np31/n31 

case studs- >ethnic = 4 

np41 = iif (&inpfield>vraper,np41+l,np41) 
n41 = iif (&inpfield>=0,n41+l,n41) 
p41 = np41/n41 

case studs- >cthnic = 5 

np5i - iif (&inpfield>vmpe: ,np51+l,np51) 
n51 = iif (&nipfield>=0,n51+l,n51) 
p51 = np51/n51 

endcase 

case ach->yaar = val(msyear) + 1 
do case 

case studs- >ethnic = 1 

npl2 = iif (&inpfield>vraper,npl2+l,nDl2) 
nl2 = iif (&inpfield>=0,nl2+l,nl2) 
pl2 = npl2/nl2 

case studs- >ethnic = 2 

np22 = iif (&inpfield>vraper,np22+l,np22) 
n22 = iif (&inpfield>=0,n22+l,n22) 
p22 = np22/n22 

case studs- >ethnic = 3 

np32 = iif (&inpfield>vraper,np32+l,np32) 
n32 = iif (£mpfield>=0,n32-rl,n32) 
p32 = np32/n32 

case studs- >ethnic = 4 

np42 = iif (&inpfield>vinper,np42+l,np42) 
n42 = iif (&inpfield>=0,n42+l,n42) 
p42 = np42/n42 

case studs->ethnic = 5 

np52 - iif (&inpfield>vmper,np52+l,np52) 
n52 = iif (&inpfield>=0,n52+l,n5?) 
p52 - np52/n52 

endcase 
case ach->year = vaKraej ^ar) 
do case 

case studs- >ethnic = 1 

npl3 = iif (&mpfield>vraper,iipl3+l,npl3) 
nl3 = iif (&mpfiela>=0,nl3+l,nl3) 
pl3 = npl3/nl3 

case studs- >ethnic = 2 

np23 = iif (&mpfield>vraper,np2:+l,np23) 
n23 = iif (&mpfield>=0,n23+l,n23) 
p23 = np23/n23 

case studs- >ethnic = 3 

np33 = iif (&mpfield>vraper,np33+l,np33) 
n33 = iif (&mpfield>=0,n33+l,n33) 
p33 = np33/n33 

case studs->ethnic = 4 
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np43 = Il£(&mp£leld>vmper,np43+l,np43) 
n43 = iif (&mpfield>=0,n43+l,n43) 
p43 = np43/n43 
case studs ->ethnic = 5 

np53 = iif (&mpf ield>vmper ^npn3+l^np53) 
n53 = iif (&mpfield>=0,n53+l,n53) 
p53 = np53/n53 

endcase 
endcase 
endif 
skip 
enddo 
clear 

nl = int((nllfnl2+nl3)/3) 
n2 = int((n21+n22+n23)/3) 
n3 = int:((n31+n32+n33)/3) 
n4 = int((n41+n42+n43)/3) 
n5 = int((n51+n52+n53)/3) 
select studs 
set index to students 
return 



******************************* ****** ************** 
♦PRINT PROCEDURE FOR HARD COPY 
procedure p_j>rint 
♦legend = • • 

9 2, 31 say 'School Level Report' 

e 6, 18 say 'Comparison of Achievement in Different Groups' 
e 8, 35 say 'Grade: '+ str(&mgrade, 2) 

e 9, 35 say 'Year: '+ str(&msyear, 2)+ '-' + str(&meyear, 2) 
e 10,24 say mname + ' by Ethnicity' 

e 14, 0 say 'PERCENTAGE OF STUDENTS A&3VE '+str(&mper,2)+' PERCENTILE' 



hll 




35 




int(pll 


* 


20) 


hl2 




35 




int(pl2 


* 


20) 


hl3 




35 




int(pl3 


* 


20) 


h21 




35 




i.it(p21 


* 


20) 


h22 




35 




int(p22 


* 


20) 


h23 




35 




int(p23 


* 


20) 


h31 




35 




int(p31 




20) 


h32 




35 




int(p32 


* 


20) 


h33 




35 




int(p33 


* 


20) 


h41 




35 




int(p41 


* 


20) 


h42 




35 




int(p42 


* 


20) 


h43 




35 




int(p43 


* 


20) 


h51 




35 




int(p51 


* 


20) 


h52 




35 




int(p52 


* 


20) 


h53 




35 




int(p53 


* 


20) 



loopl =15 
do while loopl <= 35 
stl = • • 

st2 = strdOO - (loopl - 16) * 5, 3) + '%' + ' + ' 
st3 ^ • I • 
do case 

case loopl =15 



IV-33 



70 



yaxis = stl 
case loopl - 16 

yaxis = st2 
case loopl =21 

yaxis = stl 
case loopl =26 

yaxis = st2 
case loopl =31 

yeucis = st2 
otherwise 

yaxis = st3 

endcase 
do case 

case loopl <= hi - 1 

stampll = ' ' 
case loopl = hll 

stampll = 3tr(int(pll * 100), 3) 
case loopl > hll 
stampll = 'B' 

endcase 
do ca^'e 

case loopl <= hl2 - 1 

stampl2 = ' • 
case loopl = hl2 

stampl2 = str(int(pl2 * 100), 3) 
case loopl : hi 2 
stampli = 'B' 

endcase 
do case 

case loopl <= hl3 - 1 

stampl3 = ' ' 
case loopl = hl3 

stampl3 = str(int(pl3 * 100), 3) 
case loopl > hl3 
stampl3 = 'B' 

endcase 
do case 

case loopl <= h21 - 1 

stamp21 = ' ' 
case loopl = h21 

stamp21 = str(int(p21 * 100), 3) 
case loopl > h21 
stamp21 = W 

endcase 
do case 

case loopl <= h2i - 1 

stamp22 = • • 
case loopl = h22 

stamp22 = st::(int(p22 * 100), 3) 
case loopl > h22 
stamp22 = 'V* 

endcase 
do case 

case loopl <= h23 • 1 
stamp23 = ' • 
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case loopx = h23 

stainp23 = str(int(p23 * 100), 3) 
case loopl > h23 

starap23 = *W* 

endcase 
do case 

case loopl <= h31 - 1 

starap31 = • • 
case loopl = h31 

stamp31 = str(int(p31 * 100), 3) 
case loopl > h31 
starap31 = 'A' 

endcase 
do case 

case loopl <= h32 - 1 

starap32 = • ' 
case loopl = h32 

stainp32 = str(int(p32 * 100), 3) 
case loopl > h32 
stainp32 - *A* 

endcase 
do case 

ca5>e loopl <= h33 - 1 

stainp33 = • • 
case loopl h33 

stejnp33 = str(int(p33 * 100), 3) 
case loopl > h33 
stainp33 = 'A' 

endcase 
do case 

case loopl <= h41 - 1 

stainp41 = * * 
case loopl h41 

starap41 = str(int(p41 * 100), 3) 
case loopl > h41 
stainp41 = *L* 

endcase 
do case 

case loopl <= h42 - 1 

stainp42 = * * 
case loopl = h42 

stamp42 = str(int(p42 * 100), 3) 
case loopl > h42 
stamp^-2 = 'L* 

endcase 
do case 

case loopl <= h43 - 1 

stamp43 = * * 
case loopl. = h43 

stamp43 = str(int(p43 * 100), 3) 
case loopl > h43 
stamp43 = *L* 

endcase 
do case 

c&se loopl <= h51 - 1 

erJc '^^ 



stamps 1 = ' ' 
case loopl = hSl 

stampSl = str{int(p51 * 100), 3) 
case loopl > hSl 

StampSl = '0' 

endcase 
do case 

case loopl <= hS2 - 1 

stamps 2 = ' • 
case loopl = hS2 

stampS2 = str(int(pS2 * 100), 3) 
case loopl > hS2 
stampS2 = '0' 

endcase 
do case 

case loopl <= hS3 - 1 

stampSB = ' • 
case loopl = h53 

stampS3 = str(int{p53 * 100), 3) 
case loopl > hS3 
stampS3 = 'C 

endcase 



e 


loopl ^ 0 


5*ay 


yaxis 


e 


loopl , 6 


say 


staunpll 


e 


loopl, 10 


say 


staunpl2 




loopl , 14 


say 


staunpl3 




loopl, 20 


say 


staunp2 1 




loopl, 24 


say 


staiTip22 




loopl, 28 


say 


stamp23 




loopl, 34 


say 


staunp3 1 




loopl, 38 


say 


stamp32 




loopl, 42 


say 


stamp33 


e 


loopl, 4 8 


say 


staunp41 




loopl, S 2 


say 


staunp42 




loopl, S 6 


say 


staunp43 


e 


loopl, 6 2 


say 


stanpSl 


e 


loopl, 66 


say 


staunpS2 




loopl, 70 


say 


stamps 3 



loopl = loopl + 1 



enddo 



e 


36, 2 


say 


•0%+-' 


e 


36, 6 


say 


'+ + +— • 


e 


36,62 


say 


e 


37, 0 


say 


•Year: ' 


9 


37, 6 


say 


str(&msyear,2) 


e 


37,10 


say 


str ( &msyear-t 1,2) 


e 


37,14 


say 


str(&neyear,2) 


e 


37,20 


say 


str(&msyear,2) 


e 


37,24 


say 


str ( &msyear+ 1,2) 


e 


37,28 


say 


str ( &meyear , 2 ) 


9 


37,34 


say 


str ( &insyear , 2 ) 


e 


37,38 


say 


str ( &msyear+l , 2 ) 




37,42 


say 


str(&meyear,2) 


e 


37,48 


say 


str ( &msyear , 2 ) 




37,52 


say 


str(&msyear+l,2) 
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§ 37,56 say str(&meyear,2) 
§ 37,62 say str(&msyear,2) 
@ 37,66 say str(&msyear+l,2) 
§ 37,70 say str(S.meyear,2) 



0 


38, 8 




» BLACK ' 








•JO , 


GOV 

Say 


WllliJCt 






a 


38 36 




' ACT AM ' 








38,50 


say 


' LATINO 








38,64 


say 


'OTHER' 






e 


38,74 


say 


' Ethnic 






e 


39, 8 


say 


'(n=' + 


str(nl,2) 


+ 


e 


39,22 


say 


'(n=' + 


str(n2,2) 


+ 




39,36 


say 


'(n=' + 


str(n3,2) 


+ 


e 


39,50 


say 


'(n=' + 


s*:r(n4,2) 


+ 


e 


39,64 


say 


'(n=' + 


str(n5,2) 


+ 


e 


39,74 


say 


' Group ' 





return 



************************* 

♦DISPLAY HEADING ON SCREEN 

Procedure p_head 

clear 

? 

? 

' * School Level Report' 

? 

' ' Comparison of Achievement in Different Groups* 

? • ' 

? ' Grade: '+ mgrade 

' ' Year: '+ msyear + + meyear 

' ' '+mname+ ' by Ethnicity' 

? 

? 

? 

return 
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*SHOW PROCEDURE FOR SCREEN DISPLAY 
procedure p_show 
loopl = 1 

do while loopl <= 5 



store 1 


to loop2 






do case 






case 


loopl = 1 








sec color 


to 


gr 


case 


loopl = 2 






set color 


to 


w 


case 


loopl = 3 








set color 


to 


gr+ 


case 


loopl = 4 








set color 


to 


r 


case 


loopl = 5 








set color 


to 


g 
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endcase 

do while loop2 <= 3 
do case 

case loop2 - 1 

ascii = 179 
case loop2 = 2 

ascii = 186 
case loop2 = 3 
ascii = 219 

endcase 

ynum = 'p» + strdoopl.l) + str(loop2,l) 
y = &ynum * 20 

col = loopl * 14 + loop2 * 4 - 12 
height = 21 - int(y) 
do p_bars with height^ col ^ ascii 
loop?- = loop2 + 1 
enddo 

loopl = loopl + 1 
enddo 
return 



***************************************************** 

^DISPLAY X AXIS ON SCREEN 
procedure p_xaxis 
set status off 

e 0,0 say 'PERCENTAGE OF STUDENTS ABOVE '+ str(&mper,2) + ' PERCENTILE' 
e 21,4 say '+-' 

§21,6 say replicate('+ + + ',4) 





21,62 


say 


'+ — + +_> 1 






e 


22, 2 


say 


•n: ' 








22, 6 


say 


str(nll,2) 








22,10 


say 


str(nl2,2) 








22,14 


say 


str(nl3,2) 








22,20 


s&y 


str(ri21,2) 








22,24 


say 


str(n22,2) 








22,28 


say 


str(n23,2) 








22,34 


say 


str(n31,2) 






e 


22,38 


say 


str(n32,2) 








22,42 


say 


str(n33,2) 








22,48 


say 


str(n41,2) 








22,52 


say 


str(n42,2) 






(§ 


22,56 


say 


str(n43,2) 








22,62 


say 


str(n51,2) 








A.2 , 66 


say 


str (n52,2) 






e 


22,70 


say 


str(n53,2) 






e 


23, 8 


say 


•BLACK' 






e 


23,22 


say 


•WHITE' 






e 


23,36 


say 


'ASIAN' 








23,50 


say 


'LATINO' 






e 


23,64 


say 


'OTHER' 








23,74 


say 


'Ethnic' 








24, 8 


say 


'(ns' + str(nl,2) 


+ 


•) 


e 


24,22 


say 


' (n=' + str(n2,2) 


+ 


' ) 


e 


24,36 


say 


'(n=' + str(n3,2) 


+ 


• ) 
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e 24,50 say Mn=' + str(n4,2) + 
e 24,64 say Mn=' + str(n5,2) + 
e 24,74 say 'Group' 
return 

********************* *******<if<if*********^^^^^^ 

♦DISPLAY Y AXIS ON SCREEN 

procedure p_yaxis 

e 21,2 say '0%' 

e 21,4 say '+' 

store 20 to looper 

do while looper >= 1 

if looper =1 .or. looper = 6 .or. looper = 11 .or. looper =16 
do case 

case looper = 1 

§ looper, 0 say '100%' 

§ loop<5r,4 say '+' 
case looper = 6 

§ looper, 1 say '75%' 

§ looper, 4 say '+' 
case looper =11 

§ looper, 1 say '50%' 

§ looper, 4 say '+' 
case looper =16 

§ looper, 1 say '25%' 

§ looper, 4 say '+' 

endcase 
else 

§ looper, 4 say chr(179) 
endif 

looper = looper - 1 
enddo 

e 1,76 say chr(179) 

e 2,76 say chr(179) + '-' + str (Srasyear, 2) 
e 3,76 say chr(179) 
e 6,76 say chr(186) 

e 7,76 say chr(186) + '-' + str(&rasyear+l,2) 
e 8,76 say chr(186) 
e 11,76 say chr(219) 

e 12,76 say chr(219) + '-' + str( Sraeyear ,2) 

e 13,76 say chr(219) 

return 



****************************** ^^^^^^^^^^^^^^^^^^^^^^^ 

♦DISPLAY BARS ON SCREEN 
procedure p_bars 
parameters height ^ col, ascii 
row = 20 

do while row >= height 

§ row, col say chr(ascii) 

row = row - 1 
enddo 

e row+1, col-1 say str (int( &ynum*100) ,3) + '%' 
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*************** 
** 

** Program: Bar graph program II 
** 

** Use: Generate a bar graph for supplied field 
comparing special programs 

** 

** Progrcimmer: Qi Sen 



:(r******* ************************************* 

* MAIN BAR PROCEDURE 

* CALI S SUBROUTINES 
procedure graph 

p-'ramw^ers mfield 
set escape on 

do case && DETERMINE THE TITLE AND MAXIMUM 

case mfield =^ rl' && FOR RAW SCORES 

mnsune = 'Reading Score 1 ' 

max = 20 
case mfield = ' r2 ' 

mname = 'Read! ig Score 2 ' 

max = 20 
case mfield = 'r3' 

mname = 'Reading Score 3 ' 

max = 45 
case mfield = 'rt' 

mname = 'Total Reading Score ' 

max = 85 
case mfield = 'ml' 

mname = 'Math Score 1 ' 

max = 30 
case mfield = 'm2' 

mname = 'Math Score 2 ' 

max = 15 
case mfield - 'm3' 

mname = ' Math Sc re 3 ' 

max = 72 
case mfield = 'mt' 

mnaiTie ^ 'Total Math Score ' 

max = 117 
otherwise 

mname = 'Selected Field' 
endcase 

* SET DEFAULT VALUES FOR VARIABLES 

*apfield - inf ie .d-f' per ' 

spl = .t. 

sp2 = .t. 

sp3 = .t. 

sp4 = .t. 

sp5 = ,t. 
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S3 



sp6 = 


: .t. 


ni = 


0 


n2 = 


0 


n3 = 


C 


n4 = 


0 


n5 = 


0 


n6 = 


0 


npl = 


: 0 


np2 = 


: 0 


np3 = 


: 0 


T\T\A — 




np5 = 


■ u 


npo = 




pi = 


A A A 

0.00 




0 00 


P3 = 


0.00 


p4 = 


0.00 


P5 = 


0.00 


p6 = 


0.00 



store '86' to myear 

store *N* to ans && ASK USER FOR REPORT PARAMETERS 

store * * to mgrade 

store '50' to mper 

e 6,2 say "Hard Copy?" get ans 

e 8,2 say "Grade?" get mgrade 

e 10,2 say "Year?" get myear 

e 12,2 say "Percentile" get mper 

read 

if upper (ans) ='Y' 

hard = .t. 
else 

hard - .f. 
endif 

do gx3t_data 



*PRINT REPORT 
if hard 

set device to print 

do p_print 

eject 

set device to screen 
else 
set color on 
set status off 
do p_head 
wait 
clear 

do p_xaxis 

do p_yaxis 

do p_show 

wait " " 

£ Jt Status on 

set color to w/b 
endif 
ref irn 

84 
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♦COLLECT AND TOTAL THE DATA 
Procedure get_data 
select studs 

set index to studs_nun && SET RELATIONS SO THAT 

select subj && STUDENT INFORMATION IS 

set relation to stud_num into studs && A^^AILABLE FOR WHATEVER 
select ach && RECORD IS BEING LOOKED AT 

set relation to stud_num into . cuds 
select sch 

set relation to stud^num into studs 
lalect ach 
go top 

vgrade = vaKntgradc) 
vyfiar = val(rayear) 
vmper = val(mper) 

do while .not* eof() && STEP THROUGH THE RECOPDS 

if studs->grade = vgrade .and. ach->year = vyear 
if studs- >spl 

npl = iif (Stmpf ield>vinper,npl+l,npl) 
nl = iif (Scinpf ield>=0,nl+l,nl) 

end? f 

if studs ->sp2 

np2 = iif (&mpf ield>vinper,np2+l,np2) 
n2 = iif {&mpfield>=0,n2+l,n2) 

endif 

if studs->sp3 

np3 - iif (Stmpf ield>^7inper,np3+l,np3) 
n3 = iif (inipf ield>=0,n3+l,n3) 

endif 

if studs- >sp4 

np4 = iif (Stmpf ield>vmper,np4+l,np4) 
n4 = iif (&mpfield>=0,n4+l,n4) 

endif 

if studs->sp5 

np5 = iif (Stmpf ield>vmper,np5+l,np5) 
n5 = iit{&mpf ield>=0,n5+l,n5) 

endif 

if studs->sp6 

np6 = iif (Stinpf ield>vraper,np6+l,np6) 
n6 = iif (&rapf ield>=0,n6+l,n6) 

endif 

endif 

skip 
endr'o 
clear 

pi = npl/nl 

p2 = np2/n2 

p3 = np3/n3 

p4 = np4/n4 

p5 = np5/n5 

p6 = np6/n6 

select studs 

set index to students 
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return 



*PRINT PROCEDURE FOR HARD COPY 

procedure p_print 

@ 3, 3r say 'School Level Report' 

@ 6, 16 say 'Comparison of Achievement in Di" rent Prograps' 
@ 8, 35 say 'Grade: '+ str(&mgrade, 2) 
@ 9, 35 say 'Year: '+ str(&myear, 2) 
@ 10,24 say mname + ' by Program.' 

e 14, 0 say 'PERCENTAGE OF STUDENTS ABOVE '+str(&mpar,2)+' PERCENTILE' 

yl = pi * 20 

hi = 35 - int(yl) 

y2 = p2 * 20 

h2 = 35 - int(y2) 

y3 = p3 ♦ 20 

h3 = 35 - int(y3) 

y4 = p4 * 20 

h4 = 35 - int(y4) 

y5 = p5 * 20 

h5 = ?S - int(y5) 

y6 = p6 * 20 

h6 = 35 - int(y6) 

loopl =15 

do while loopl <= 35 
stl = ' ' 

st2 = strdOO " (loopl - 16) * 5, 3) + '%' + ' + 
st3 = ' j' 
stampl - 
stamp2 = 
stamp3 = 
stamp4 = 
starop5 = 
stamps = 
do case 

case loopl = 15 
yaxis = stl 

case loopl=16 .or. loopl=21 .or. loopl=26 .or. ioopl=31 

yaxis = st2 
otherwise 

yaxis = st3 

endcase 
do cabe 

case loopl <= hi - i 

stampl = ' ' 
case loopl = hi 

stampl = str(int(pl * 100), 3) + '%' 
case loopl > hi 

stampl = '##' 

endcase 
do case 

case loopl <= h2 - 1 
stamp2 = ' * 

case loopl = h2 

erJc "-"hg 



stainp2 = str(int(p2 * 100), 3) + 
case loopl > h2 

stamp2 = '##' 

endcase 
dc rase 

case loopl <= h3 - 1 

stamps = ' ' 
case loopl = h3 

stamp3 = str(int(p3 * xOO), 3) + 
case loopl > h3 

stamp3 = '##' 

endcase 
do case 

case loopl <= h4 - 1 

stamp4 = ' ' 
case loopl = h4 

stamp4 = str(int(p4 * 100), 3) + 
case loopl > h4 

stanip4 = '##' 

endcase 
do case 

case loopl <= h5 - 1 

stamps = ' ' 
case loopl = h5 

stamps = str(int(p5 * TOO), 3) + 
case loopl > h5 
stamps = 

endcase 
do case 

case loopl <= h6 - 1 

ste.mp6 =^ ' ' 
case loopl = h6 

stamps = str(iit(p6 * 100), 3) + 
case locol > h6 

stamps = •##• 

endcase 

9 loopl, 0 say yaxis 
6 loopl, 8 say stampl 
% loopl, 20 say stamp2 
% loopl, 32 say stamp3 
6 loopl, 44 s£.y stamp4 
% loopl, 56 say stampS 
% loopl, 68 say stamp6 
loopl = loopl V 1 
enddo 

e 36, 2 say '0%+' 
i 36, 5 say +• 

e 36, 9 say replicate (' 5) 

i 36.6'^ say Special' 

e 37, b say 'CHAPl' 

9 3"/, 18 say 'GIFTD' 

i 37,30 say 'BILIN' 

i 37,42 say 'STATE' 

e 37,54 say 'MU' 

e 37,66 say 'SCHAV 
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e 37,73 say 'Program' 



e 38, 6 say 
% 38,18 say 
e 38,30 say 
e 38,42 say 
e 38,54 say 
% 38,66 say 
return 



(n=' + str(nl, 2) + 
(n=' + str(n2, 2) + 



(n=' 

(u=' 

(n=' 
(n=' 



str (n3 , 
str (n4, 
str(:i5, 
str(n6. 



2) 
2) 
2) 
2) 



+ 
+ 
+ 
+ 



***************************************************** 

♦SHOW PROCEDURE FOR SCREEN DISPLAY 
procedure p_show 
loopl = 1 

do while loopl <= 6 



do case 








case 


loopl = 1 








set color 


to 


gr 


case 


loopl = 2 








set color 


to 


w 


case 


loopl = 3 








set color 


to 


gr+ 


case 


loopl = 4 








set cc ^r 


to 


r 


case 


loopl - 5 








set color 


to 


g 


case 


loopl = 6 








set color 


to 


bg 


endcase 








ynuin = 


p' + str ( loopl, 1) 



y = ftynum * 20 
col = (loopl-1) * 12 + 8 
height = 21 - int(y) 
do p_bars with height, col 
loopl = loopl + 1 

enddo 

return 



****************«***********************^**ir ******** 

*DI SPLAY HEADING ON SCREEN 

Procedure p_head 

clear 

? 

? 

7 ' 



? 



School Level Report' 
Compariso:. of Achievement in Different Programs* 



? ' 

? ' Grade: '+ mgrade 

? • Yeai. '+ myear 

? ' •+mnajne+ ' by Progreun* 

? 
? 

IV-A6 
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? 

return 



***************************************************** 

♦DISPLAY X AXIS ON SCREEN 
procedure p_xaxis 
set status off 

e 0^0 say 'PERCENTAGE OF STUDENTS ABOVE '+ str( imper ^ 2 ) + ' PERCENTILE' 
e 21,4 say '+' 
e 21.5 say +• 





21, 9 


say 








21,69 


say 


' — Special ' 
'CHAPl' 






22, 6 


say 




e 


22,18 


say 


'GIFTD' 






22,30 


say 


'BILIN' 






22,42 


say 


' STATE • 






22,54 


say 


'MU' 






22,66 


say 


'SCHAV 






22, V 


say 


'Frogreun' 






23, 6 


say 


(n=' + str(nl,2) 


+ 




23,18 


say 


' (n=' + str(n2,2) 


+ 




23,30 


say 


' (n=' + str(n3,2) 


+ 




23,42 


say 


'(n=' + str(n4,2) 


+ 




23,54 


say 


' (n=' + str(n5,2) 


+ 




23,66 


say 


'(n=' + str(n6,2) 


+ 



•+'.5) 



return 



looper = 6 .or. looper = 11 .or. looper =16 



********************************** A ************ ****** 

♦DISPLAY Y AXIS ON SCPEEN 
procedure p_yaxis 
e 21,4 say •+' 
store 1 to looper 
e 21,2 say *0%* 
store 20 to looper 
do while looper >= \ 
if looper =1 .or 
do case 

case looper = 1 

6 looper, 0 say 
e looper, 4 say 
case looper = 6 

e looper, 1 say 
% looper, 4 say 
case looper =11 

6 looper, 1 say 
6 looper, 4 say 
case looper =16 

e looper, 1 say 
e looper, 4 say 

endcase 
elso 



'100%' 
'75%' 
'50%' 
'25%' 
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§ locper,4 say ' 
endif 

looper = looper - l 
enddo 
return 



******************************* *********** X***** 

♦DISPLAY BARS ON SCREEN 
procedure p_bars 
parameters height, col 
row = 20 

do while row >= height 

§ row, col say chr(219) 

row = row - 1 
enddo 

§ row+1, col+1 say str(int(&ynuin*100) ,3) + 
return 
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************* A ***^****«r*************:^*** V c ******************** 
** 

** Program: Bar graph program III 

** Use: Generate a bar graph for supplied field 

** comparing between sexes 

** 

** Progrcunmer: Qi Se.^ 
** 

********************************** **************^*^^^^^^^^^^^^ 



**************************************************** ^^^^^^^^^^ 

* MAIN BAR kllOCEDURE 

* CALLS SUBROUTINES 
procedure graph 

parameters mfield 
set escape on 

do case S6 DETERMINE THE TITLE AND MAXIMUM 

case mfield = 'rl' && 50R RAW SCORES 

mname = 'Reading Score 1 ' 

max ^ 20 
case mfiexd ^ 'r2' 

mname = 'Reading Score 2 ' 

max ^ 20 
case mfield = 'r3' 

mname - 'Reading Score 3 ' 

max ^ 45 
case mfield - 'rt' 

mname = 'Total Reading Score ' 

max - 35 
case mfield ^ 'ml' 

mname = 'Math Score 1 ' 

m^?ix = 30 
case mfield - 'm2' 

mname = 'Math Score 2 ' 

max = 15 
case mfield ^ 'm3' 

mname = 'Math Score 3 ' 

max = 72 
case mfield = 'mt' 

mnojne = 'Total Math Score ' 

max = 117 
otherwise 

mnawe = 'Selected Field' 
endca<;e 

* SET DEFAULT VALUES FOR VAP.IAB.uES 
sex = 'F' 

rapfield = mfisld+'per' 
nl = 0 
n2 = 0 
n3 = 0 
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nil = 0 
nl2 = 0 
nl3 = 0 
n21 = 0 
n22 = 0 
n23 = 0 
npll = 0 
npl2 = 0 
npl3 = 0 
np21 = 0 
np22 = 0 
np23 = 0 
pli = 0.00 
pl2 = 0.00 
pl3 = 0.00 
p21 0.00 
p22 = 0.00 
p23 = 0.00 

store 'SA* to msyear 
store 'Se' to meyear 

store 'N* to ans && ASK USER FOR REPORT PARAMETERS 

store • • to ragrade 

store 'SO* to raper 

store to msex 

e 6,2 say "Hard Copy? " get ans 

e 8,2 say "Grade? " get ragrade 

e 10,2 say "From Year? get rasyear 

9 12,2 say "To Year? " get meyear 

e 14,2 say "Percentile?" get raper 

read 

if ui^^r(ans) =*Y' 

hard = .t* 
else 

hard = .f . 
endif 

do get_data 

♦PRINT REPORT 
if hard 

set device to print 

do p_print 

eject 

set device to screen 
else 
set color on 
set status off 
do p_head 
wait 
clear 
do p_xaxis 
do p_yaxis 
do p show 
wait^** " 
set status on 
set color to w/b 
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&& SET RELATIONS SO THAT 

&& STUDENT INFORMATION IS 

&& AVAILABLE FOR WHATEVER 

&& RECORD IS BEING LOOKED AT 



&& STEP THROUGH THE RECORD 



return 

************************************* 

★COLLECT AND TOTAL THE DATA 
Procedure get_data 
select studs 
set index to studs_nuin 
select subj 

set relation to stuc^num into studs 
select ach 

set relation to stud^num into studs 
select sch 

set relation to stud^num into studs 
select ach 
go top 

vgrade = val(ragrade) 
vmper = val(mper) 
do while .not. eo£() 

i£ studs- >grade ^ vgrade 
do case 

case ach->year = val(rasyear) 
do case 

case studs- > sex = chr(70) 

npll = iif (&inpfield>vinper,npll+l^npll) 
nil = iif (&mpfield>=0,:ill+l,nll) 
pll = npll/nll 
case studs- >sex = chrJ77) 

np2. = iif (&mpl:ield>vinper,np21+lfnp21) 
n21 = iif (&rapfield>=0,n21+l,n21) 
p21 - np21/n21 

endcase 

case ach->year = vaKmsyear) + 1 
do case 

case studs- >sex = chr(70) 

npl2 = ii£(&mp£ield>vinper,npl2+l,npl2) 
nl2 = iif (&mpfield>=0,nl2+l,nl2) 
pl2 = npl2/nl2 

case studs- >sex = clir(77) 

np22 = iif (&rapf ield>vroper,np22+l,np22) 
n22 = iif (&rapfield>=0,n22+l,n22) 
p22 = np22/n22 

endcase 
case ach->year = val(raeyear) 
do case 

case studs->sex = chr(70) 

npl3 = iif (&rapf ield>vraper^npl3+l^npl3) 
nl3 = iif (&rapfield>-0,nl3+l,nl3) 
pl3 = npl3/nl3 
studs->sex = chr(77) 

np23 = iif (fcrapf ield>vroper^np23+l,np23) 
n23 = iif (&rapfield>=0,n23+l,n23) 
p23 = np23/n23 



case 



endcase 
endcase 
endi£ 
skip 
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enddo 
clear 

nl = int( (nll+nl2+nl3)/3) 

n2 = int( (n21+n22+n23)/3) 

select studs 

set index to students 

return 



***************************************************** 

♦PRINT PROCEDURE FOR HARD COPY 

procedure p_print 

e 3, 31 say 'School Level Report' 

e 6, 18 say 'Comparison of Achievement in Different Groups' 
e 8, 35 say 'Grade: '+ str(&mgrade, 2) 

e 9, 35 say 'Year: '+ str(ransyear, 2)+ '-' + str(&meyear, 2) 
e 10,24 say mname + ' by Gender' 

e 14, 0 say 'PERCENTAGE OF STUDENTS ABOVE ' +scr ( iraper , 2 )+ ' PERCENTILE' 

hll = J5 - int(pll * 20) 

hl2 = 35 - int(pl2 * 20) 

hl3 = 35 - int(pl3 * 20) 

h21 = 35 - int(p21 * 20) 

h22 = 35 - int(p22 * 20) 

h23 = 35 - int(p23 * 20) 

loopl =15 

do while loopl <= 35 
stl = ' ' 

st2 = strdOO - (loopl - 16) * 5, 3) + '%' + ' + ' 
st3 = • I ' 
do case 



case 


loopl 




15 




y^-^xis 




stl 


case 


Iv ^pl 




16 




Ycucis 




st2 


case 


loopl 




21 




yaxis 




st2 


case 


loopl 




26 




yaxis 




st2 


case 


loopl 




31 




yaxis 




st2 


otherwise 








yaxis 




st3 



endcase 
do case 

case loopl <= hll - 1 

steunpll = ' ' 
case loopl = h 1 

sto^iipll = str(int(pll * 100), 3) 
case loopl > hll 
stampll 

endcase 
do case 

case loopl <= hl2 - 1 
stampl2 = • • 

case loopl = hl2 
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stainpl2 = str(int(pl2 * 100), 3) 
case loopl > hl2 
stainpl2 = 

endcase 
do case 

case loopl <= hl3 - 1 

stamplB = ' ' 
case loopl = hl3 

StamplB = str(int(pl3 * 100), 3) 
case loopl > hl3 
stainpl3 = 

endcase 
do case 

case loopl <= h21 - 1 

stainp21 = ' ' 
case loopl = h21 

stainp21 = str(int(p21 * 100), 3) 
case loopl > h21 
stamp21 = 'I' 

endcase 
do case 

case loopl <= h22 - 1 

stainp22 = ' ' 
case loopl = h22 

stainp22 = str(int(p22 * 100), 3) 
case loopl > h22 
stainp22 = 'I' 

endcaae 
do case 

case loopl <= h23 - 1 

stainp23 = ' ' 
case loopl = h23 

stainp23 = str(int(p23 * 100), 3) 
case loopl > h23 
stainp23 = 'I' 

endcase 

e loopl, 0 say yaxis 
e loopl, 15 say stampll 
e loopl, 22 say stainpl2 
e loopl, 29 say stainpl3 
e loopl, 50 say stainp21 
e loopl, 57 say stainp22 
e loopl, 6 4 say stainp23 
loopl = loopl + 1 
enddo 

e 36, 2 say '0%+' 

e 36, 5 say replicate ( ' + + + 

e 37, 0 say 'Year:' 
e 37,14 say str ( &msyear ,2 ) 
e 37,21 say str(&msyear+l,2) 
e 37,28 say str( &meyear ,2 ) 
e 37,49 say str( &msyear ,2 ) 
» 37,56 say str ( &msyear+l ,2) 
e 37,63 say str( &meyear ,2 ) 
e 38,19 say 'FEMALE* 
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e 38,55 say 'MALE' 

e 38,70 say 'Gender' 

e 39,19 say '(n=' + str(nl,2) + ') 

e 39,55 say '(n=' + str(n2,2) + ') 

return 



********** ************************1lr*******l^^ 

♦DISPLAY HEADING ON SCREEN 

Procedure p_head 

clear 

? 

? 

? ' School Level Report' 

? 

? ' Comparison of Achievement in Different Groups' 

? ' ' 

? ' Grade: '+ mgrade 

? ' Year: '+ msyear + '--' + mcyear 

? ' '+mname+ ' by Gender' 

? 

? 

? 

return 



***************************************************** 

*SHOW PROCEDURE FOR SCREEN DISPLAY 
procedure p_show 
loopl = 1 

do while loopl <= 2 
store 1 to loop2 
do case 

case loopl = 1 

ascii = 12 
case loopl = 2 
ascii = 11 

endcase 

do while loop2 <= 3 
do case 

case loop2 = 1 

set color to bg 
case loop2 = 2 

set color to r 
case loop2 = 3 

set color to gr+ 

endcase 

ynum = 'p' + str( loopl, 1) + str(loop2,i) 
y = &ynum 20 

col - loopl * 35 + loop2 * 7 - 27 
height = 21 - ir.t(y) 
do p_bars with height, col, ascii 
loop2 = loop2 + 1 
enddo 

locpl = loopl + 1 
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enddo 
return 



♦DISPLAY X AXIS ON SCREEN 
procedure p_xaxis 
set status off 

e 0,0 sai "PERCENTAGE OF STUDENK ABOVE '+ str(&mper,2) + ' PERCENTILE' 
e 21,4 say 

e 21,5 say replicate ( ' + + + \2) 

e 22, 0 say 'Year: ' 

@ 22,14 say str (&msyear,2) 

e 22,21 say str(&msyear+l,2) 

@ 22,28 say str(&ineyear,2) 

@ 22,49 sciy str«'&msyear,2) 

e 22,56 say str(&msyear+l,2) 

@ 22,63 say str (&meyear,2) 

e 23,19 say 'FEMALE' 

e 23,55 say 'MALE' 

e 23,70 say 'Gender' 

e 24,19 say '(n=' + str(nl,2) + ')' 

e 24,55 say '(n=' + str(n2,2) + ')' 

return 

********************************** 

♦DISPLAY Y AXIS ON SCREEN 

procedure p yaxis 

e 21,2 say "^0%' 

e 21,4 say '+' 

store 20 to looper 

do while looper >= 1 

if looper =1 .or. looper = 6 .or. looper = 11 .or. looper =16 
do case 

case looper = 1 

§ looper, 0 say '100%' 
§ looper, 4 say '+' 
case looper = 6 

§ looper, 1 say '75%' 
§ looper, 4 say '+' 
case looper =11 

§ looper, 1 say '50%' 
§ looper, 4 say '+' 
case looper =16 

§ looper, 1 say '25%' 
§ looper, 4 say '+' 

endcase 
else 

@ looper, 4 say chr(179) 
endif 

looper = looper - 1 
enddo 
return 
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CHOOSE 


TYPE OF REPORT: 


1. 
2. 

o • 


STUDENT AT A GLANCE 
TEST SCORES OVER TIME 
LUroFARISON AMONG GROUPS 


0. 


EXIT 

— select 1 ' 



Command ||<C:>||ACH ||Rec: 1/228 || || 



Teacher? (want a list?) Y 



Command ||<C:>||ACH j|Mec: 1/228 

teacher 
Brovm 
Jackson 
Jameson 
Standar 
Testing 

Press any key to continue... 
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Cortland 



||<C:>||STUDS 



||Rec: 14/81 



Which teacher? Brovm 
Hard copy? Y 



Coimnand 



||<C:>||STUDS 



||Rec: 51/81 
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STUDEHTS AT A GLANCE 

Teacher: Brovm 08/18/87 







w 


c 






Is 






A 


P 


P 






p 


ir 




P 


1/ 


> 

A 


m 

T 


mi 
M 


R 


R 






A 


P 


A 


A 


V 


T 


V 


T 


H 


S 


Student 


Student 


D 


R 


B 


D 


A 


H 


A 


H 


L 


U 


Number 


Name 


p 


VJ 


c 


a 
% 


T 
ii 




T 

u 


W 


r 


P 


7883432 






• 




1 1 




39 


3.3 


4 . 0 


3.2 


4.0 


4321339 

^ J X J J 7 






m 

T 


•7 
/ 






59 




If 




ft 


7783216 


Chambers , Sharo 


2 


• 


11 


70 


3,3 


34 


3.0 


1.2 


0.0 


0.0 


9849030 


Connors, Daniel 


2 


• 


7 


62 


1,1 


49 


2.2 


2.3 


3.0 


4.4 


7890322 


Donaldson . Mark 


2 


• 


7 


* 


2 






J» . 4 


4 . i 


O A 

2.4 


3324870 


Edward fi aTam^Q 


o 


T 
X 




DO 




!>4 


4 . U 


3 . 0 


1.4 


1 . 3 


4335314 


J ohnson . D^bb i © 


2 


T 

X 


Q 
O 


2Q 


Z • Z 




/ . 4 


i . 4 


2 . U 


3 . 0 


5678390 


JoneL Mary 


2 


6 


10 


66 


1.0 


36 


3.0 


1.2 


1.3 


2.0 


7890232 


M&rshall, Diann 


2 


• 


10 


57 


2.3 


50 


3.0 


1.2 


1.0 


1.0 


7787568 


Monroe , Thomas 


2 


• 


Q 


u J 


4 • u 


'xn 
J / 


J . 4 


2 . i 


1 . U 


1 . 0 


4439382 


N A d a T* T^on Am r\ 
navxa^ , Odijcuiixli 






1 1 


!) / 


i • i 


34 


2 . 2 


3.0 


1. 4 


1.2 


7783219 


Owe ns Pnn a Irl 


2 


w 


1 2 


O / 


o o 
z • u 


Ai 
41 


i . U 


3 . 0 


2 . 4 


2. 3 


3321332 


Parker, Karen 


2 


GT 


10 


52 


3,3 


71 


4 0 


1 n 


1 1 


1 n 
X • yj 


7777432 


Peters, Mike 


2 


G 


11 


57 


2-2 


36 


1.0 


2.2 


1.4 


2.3 


4343210 


Pike, Charles 


2 


I 


8 


23 


2,1 


35 


2.0 


2.3 


2.0 


3.0 


6753210 


Rogers, Grace 


2 


• 


10 


57 


1,1 


47 


2.3 


2.0 


1.3 


4.0 


7798321 


Shaw, Tom 


2 


• 


5 


37 


2.2 


51 


1.3 


3.3 


1.2 


3.1 


8498399 


Sherwood, Steve 


2 


G 


8 


78 


* 


44 


* 


* 


* 


* 


5226780 


Tyler, John 


2 


• 


5 


70 


1.4 


38 


3.1 


2.2 


1.2 


1.3 


7865308 


Washington, Dav 


2 


6 


13 


49 


3.0 


33 


3.4 


3.0 


2.3 


3.0 




IV-58 



ICO 



***************************************************** 

*DISPLAY BARS ON SCREEN 
procedure p_bars 
parameters height, col,ascii 
row = 20 

do while row >= height 

9 ro^,col say chr(ascii) 

row = row - 1 
enddo 

% row+1, col-1 say str(int(&ynum*100) ,3) + 
return 
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1'): 



CHOOSE TYPE OF REPORT 



1. STUDENT AT A GLANCE 

2. TEST SCORES OVER TIME 

3. COMPARISON AMONG GROUPS 

0. EXIT 

= select 2 ■ 



Command 



||<C:>||STUDS 



HRec: EOF/81 



CHOOSE FIELD TO COMPARE 



Hard Copy? Y 

Teacher? (want a list?) N 
Teacher? Brown 
Grade? 2 



1. Reading 1 

2. Rc;<&ding 2 

3. Reading 3 

4. Reading Total 

5. Math 1 

6. Math 2 

7. Math 3 

8. Math Total 

0. EXIT 

select 1 == 



Command 



11 <C:>|| STUDS 



||Rec: EOF/ 81 
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Comparison of Test Scores 
Teacher: Brown 
85 - 86 

Grade : 2 
Reading Score 1 



Total number of students with data for 1986; 
Average Raw score: 12.47 
Average Percentile score: 51.00 



19 



Total number of students with data for 1985: 
Average Raw score: 12.75 
Average Percentile score: 51.00 



20 



85 



86 



Raw Scores 
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CHOOSE TYPE OF REPORT 



0 
11- 



1. STUDENT AT A GLANCE 

2. TEST SCORES OVER TIME 

3. COMPARISON AMONG GROUPS 

0. EXIT 

=^= select 3 =^=^^^= 



Comraand ||<C:>||STUDS ||Rec: 14/81 H 

CHOOSE TYPE OF COMPARISON 



1. AMONG ETHNIC GROUPS 

2. AMONG SPECIAL PROGRAMS 

3. BETWEEN SEXES 

0. EXIT 

=^= select 1 = 



Command 



II <C:>|| STUDS 



||Rec: 14/81 



CHOOSE FIELD TO COMPARE 



Hard Copy? Y 
Grade? 4 
From Year? 84 
To Year? 86 
Percentile? 50 



ERIC 



|<C:>|STUDS 



1. Reading 1 

2. Reading 2 

3. Reading 3 

4. Reading Total 

5. Math 1 

6. Math 2 

7. Math 3 

8. Math Total 

0. EXIT 



select 8 » 
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1 ■'1 

RRec: 14/81 



School Level Report 



Comparison of Achievement in Different Groups 

Grade : 4 
Year: 84-86 
Total Math Score by Ethnicity 
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100%+ 



75%+ 
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50%+ B B 
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Year: 84 85 
BLACK 
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(n- 3) Groui 




lV-63 



CHOOSE TYPE OF COMPARISOK 



1. AMONG ETHNIC GROUPS 

2. AMONG SPECIAL PROGRAMS 

3. BETWEEN SEXES 

0. EXIT 

=^= select 2 — 



C(»ninand 



||<C:>||STUDS 



lec: 14/81 



CHOOSE FIELD TO COMPARE | 


Hard Copy? 


Y 








1. Reading 1 M 


Grade? 6 




2. Reading 2 






3. Reading 3 


Year? 86 




4. Reading Total 






5. Math 1 


Percentile 


50 


6. Math 2 






7. Math 3 






8. Math Total 






0. EXIT 






=== select 7 ==^=^=^^= * 



Command 



||<C:>||STUDS 



iec: 14/81 
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School Level Report 



Comparison of Achievement in Different Programs 

Grade: 6 
Year: 86 
Math Score 3 by Program 



PERCENTAGE OF STUDENTS ABOVE 50 PERCENTILE 
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10? 



CHOOSE TYPE OF COMPARISON 



1. AMONG ETHNIC GROUPS 

2. AMONG SPECIAL PROGRAMS 

3. BETWEEN SEXES 

0. EXIT 

^=^= select 3 = 



Command 



|j<C: >||STUDf 



||Rec: 14/81 





CHOOSE 


FIELD TO COMP/. RE 


Hard Copy? 


Y 








1. Reading 1 


Grade? 


4 


2. Reading 2 






3. Reading 3 


From Year? 


84 


4. Reading Total 






5. Math 1 


To Year? 


86 


6. Math 2 






7. Math 3 


Percentile? 


50 


8. Math Total 






0. EXIT 






— select 5 ^^k^^s=^=s^^=^^^^b^bJ 



Command 



||<C:>||STUDS 



iRec: 14/81 
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School Level Report. 



Comparison of Achievement in Different Groups 



Grade : 4 
Year: 84-86 
Math Score 1 by Gender 
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FIGURE 2 
DISTRICT HROFILE 
STUDENT OUTCOMES 4 PERCEPTIONS 
Percent of Students Responding Positively or Above National Average 



Achievement Attitudes School Teacher Expectations Parent 

Reading* Math* SAM* * Reading Math Climate Achievement Discipline Support 



Cynv.'J 
5th 



61.2 



87.1 



25.0 71.4 45.7 



100.0 



77.1 



65.7 



85.7 



Cladwyne 
4th 
5th 



70.0 80.0 
68.2 81.8 



30.4 58.3 79.2 95.8 
41.7 66.7 45.8 95.8 



66.7 
79.1 



79.2 
70.8 



87.5 
91.7 



District 
4th 
5th 



70.0 80.0 30.4 58.3 79.2 95.8 

64.1 84.9 30.6 69.6 45.7 98.4 



66.7 
77.9 



79.2 
67.6 



87.5 
88.0 



*% scoring at least .5 years above grade level on standardized tests. 
1 ^ **% scoring significantly above national average on Student Attitude Measure. 

For all other measures except school climate, responding positively was defined as scores at or above 3 on a 4 point 
scale where 4 » very positive. For school cllma*/;, scores at or above 2.5 were defined as responding positively. 



5TH GRADE SCHOOL OUTCOMES AND PERCEPTIONS* 

BY SEX, ETHNICITY AND LXAL PROGRAM PARTICIPATION 





Achievement Scores 


Attitudes 


Parent 


Teacher Expectations 


School 


Sex 


Reading 


Hath 


Reading 


Math 


Support 


Achievement 


Discipline 


Climate 


Male 


45.5 


38.5 


3.3 


3.3 


3.6 


3.7 


3.3 


2,6 


Female 


43.2 


34.6 


3.2 


2.9 


3.6 
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43.6 


36.3 
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2.9 


No Program 


45.3 


36.1 


3.3 


2.9 


3.5 


3.4 




2.7 



*Based on mean raw scores; for all measures except achievement, scores represent an averaged score on a 4 point scale 
where 4 = very positive. For achievement, total possible In Reading « 60; In Math « 50. 
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• Figure 4 
SCHOOL 

Percent Responding Positively To Aspects of School Clinate 



ERIC 



student Perceptions of 



Physical Plant Student s Principal Teachers 

4th Grade 75.0 75.0 95.8 95.8 

5th Grade 66.7 70.8 100.0 100.0 



Figure 5 



School 



5th Reading Achievement 
by Subgroup 
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Figure 6 
CLASSROOM ROSTER 



School: School 
Teacher: (184-34) 
Grade: 4th 



Student Characteristics 

Total Number of Students: 24 

% Male 39.3 
% Female 6C.7 



Local Program 


# 


2 


Challenge 


1 


3.6 


Resource Room 




7.1 


Speech 


1 


3.6 


Title I 


1 


7.1 



Total 6 24. 1 



Student Achievement : 

. g Above Grade Level X Below Grade Level 

Reading Total 68.2 31.8 

Math Total 81.8 18.2 



Sttident Attitudes (percent responding positively) : 

Toward reading: 83.3 
Toward math: 58.3 
Toward self in school: 30.4 

Perceptions: 

Teacher expectations for achievement: 79.2 

Teacher expectations for discipline: 66.7 

Parent support for school: 87.5 

Perceptions of school: 95.8 
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STUDENTS AT A GLANCE 
Teacher: Brovm 



Figure 7 
08/18/87 
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Figure 8 
DISTRICT AT A GLANCE 
Fourth Grade 
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R = Percentile Score on Standardized Reading Test 

M = Percentile Score on Standardized Math Test 

L ■■ Percentile Score on Standardized Language Test 

SC = Percentile Score on Academic Self Concept 
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Figure 9 
SCHOOL AT A GLANCE 
Academic Self Concept 
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Fig\Are 10 
SCHOOL AT A OUNCE 
Perceptions of School Climate 
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Minutes of homework 

Plot of minutes of homework versus test scores, x's repre.-ent 
one school, O's represent a second school. Some students in 
school X seem to do much less homework than those in school 0. 
School 0 students seem to obtain higher scores, even when homework 
time is similar. 
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